Comments (11)
more Error message:
Unhandled Exception: System.UnauthorizedAccessException: Access to the path 'C:\
Program Files (x86)\MySpace.DataMining\Qizmt\jid.dat' is denied.
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, I
nt32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions o
ptions, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access,
FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean
bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access,
FileShare share, Int32 bufferSize, FileOptions options)
at System.IO.StreamWriter..ctor(String path, Boolean append, Encoding encodin
g, Int32 bufferSize)
at System.IO.StreamWriter..ctor(String path, Boolean append, Encoding encodin
g)
at System.IO.File.WriteAllText(String path, String contents, Encoding encodin
g)
at MySpace.DataMining.AELight.AELight.AELightRun(String[] args) in C:\SimpleS
olutions\DataMining\DistributedObjects5\AELight\AELight.cs:line 1878
at MySpace.DataMining.AELight.AELight.Main(String[] args) in C:\SimpleSolutio
ns\DataMining\DistributedObjects5\AELight\AELight.cs:line 1644
Job aborted abruptly; to clean up intermediate data and processes, issue command
: Qizmt kill 3
Original comment by [email protected]
on 12 May 2010 at 4:32
from qizmt.
By the way, is the login name as
My Login Name
that is, with space, allowed?
Original comment by [email protected]
on 12 May 2010 at 4:33
from qizmt.
the account used to install needs read/write access to
\\<host>\<drive>$\<installdir>\
http://code.google.com/p/qizmt/wiki/MySpaceQizmtFAQInstallation
Original comment by [email protected]
on 24 Jun 2010 at 4:08
from qizmt.
I solved the problem by installing Qizmt in another directory other than the
default one. However, after installing Qizmt in two Machines, say shark01
shark02, I can format them by doing
Qizmt @format Machines=shark01,shark02
and then run
Qizmt examples
but when I run the example
Qizmt exec Qizmt-WordCount.xml
I got the error message as below.
Dan, could you kindly let me know how to solve it? Thank you very much in
advance!
By the way, both machines are running Windows 7.
C:\>Qizmt exec Qizmt-WordCount.xml
Job Identifier: 58
[6/25/2010 6:53:34 PM] [Local: PrepJob]
*
[6/25/2010 6:53:38 PM] Done
Duration: 00:00:03
[6/25/2010 6:53:38 PM] [Remote: wordCount_LoadData]
1 processes on 2 machines:
*
[6/25/2010 6:53:39 PM] Done
Output: dfs://WordCount_Input.txt
Duration: 00:00:02
[6/25/2010 6:53:39 PM] [MapReduce: WordCount]
Legend: m = map done; e = exchange done; s = sort done; r = reduce done
11 processes on 2 machines:
mmmmmm.. <!> Unable to connect to DistributedObjects service on shark04: Thread
exceptionSystem.Exception: Error in Open: System.Net.Sockets.SocketException: A
connection attempt failed because the connected party did not properly respond a
fter a period of time, or established connection failed because connected host h
as failed to respond 192.168.0.2:55900
at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
at System.Net.Sockets.Socket.Connect(String host, Int32 port)
at MySpace.DataMining.DistributedObjects5.DistObject.Open() [Note: ensure th
e Windows service is running]
at MySpace.DataMining.DistributedObjects5.DistObject.Open()
at MySpace.DataMining.DistributedObjects5.ArrayComboList.Open()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.ensureopen() in C:\S
impleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 702
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.firstthreadproc() in
C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line
732
<!> Unable to connect to DistributedObjects service on shark04: Thread exceptio
nSystem.Exception: Error in Open: System.Net.Sockets.SocketException: A connecti
on attempt failed because the connected party did not properly respond after a p
eriod of time, or established connection failed because connected host has faile
d to respond 192.168.0.2:55900
at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
at System.Net.Sockets.Socket.Connect(String host, Int32 port)
at MySpace.DataMining.DistributedObjects5.DistObject.Open() [Note: ensure th
e Windows service is running]
at MySpace.DataMining.DistributedObjects5.DistObject.Open()
at MySpace.DataMining.DistributedObjects5.ArrayComboList.Open()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.ensureopen() in C:\S
impleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 702
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.firstthreadproc() in
C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line
732
<!> Unable to connect to DistributedObjects service on shark04: Thread exceptio
nSystem.Exception: Error in Open: System.Net.Sockets.SocketException: A connecti
on attempt failed because the connected party did not properly respond after a p
eriod of time, or established connection failed because connected host has faile
d to respond 192.168.0.2:55900
at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
at System.Net.Sockets.Socket.Connect(String host, Int32 port)
at MySpace.DataMining.DistributedObjects5.DistObject.Open() [Note: ensure th
e Windows service is running]
at MySpace.DataMining.DistributedObjects5.DistObject.Open()
at MySpace.DataMining.DistributedObjects5.ArrayComboList.Open()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.ensureopen() in C:\S
impleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 702
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.firstthreadproc() in
C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line
732
<!> Unable to connect to DistributedObjects service on shark04: Thread exceptio
nSystem.Exception: Error in Open: System.Net.Sockets.SocketException: A connecti
on attempt failed because the connected party did not properly respond after a p
eriod of time, or established connection failed because connected host has faile
d to respond 192.168.0.2:55900
at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
at System.Net.Sockets.Socket.Connect(String host, Int32 port)
at MySpace.DataMining.DistributedObjects5.DistObject.Open() [Note: ensure th
e Windows service is running]
at MySpace.DataMining.DistributedObjects5.DistObject.Open()
at MySpace.DataMining.DistributedObjects5.ArrayComboList.Open()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.ensureopen() in C:\S
impleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 702
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.firstthreadproc() in
C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line
732
<!> Unable to connect to DistributedObjects service on shark04: Thread exceptio
nSystem.Exception: Error in Open: System.Net.Sockets.SocketException: A connecti
on attempt failed because the connected party did not properly respond after a p
eriod of time, or established connection failed because connected host has faile
d to respond 192.168.0.2:55900
at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
at System.Net.Sockets.Socket.Connect(String host, Int32 port)
at MySpace.DataMining.DistributedObjects5.DistObject.Open() [Note: ensure th
e Windows service is running]
at MySpace.DataMining.DistributedObjects5.DistObject.Open()
at MySpace.DataMining.DistributedObjects5.ArrayComboList.Open()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.ensureopen() in C:\S
impleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 702
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.firstthreadproc() in
C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line
732
[6/25/2010 6:54:01 PM] Map done; starting map exchange
.................................................
Original comment by [email protected]
on 26 Jun 2010 at 2:05
from qizmt.
Thanks for the workaround on the install directory! We will look into having a
better default for this or other solution.
As far as the error you are getting from running the built-in word count job:
from within your private LAN, try at command line:
telnet <host> 55900
if it fails, make sure there are no ports over 1000 blocked between the servers
of your cluster only.
Also note, Qizmt should not be installed on servers which can be accessed from
the internet. It is for private LAN only.
Original comment by [email protected]
on 26 Jun 2010 at 4:07
from qizmt.
Hi, Dan, I tried
telnet <host> 55900
at command line, it works OK.
Also, we installed Qizmt in Windows 7 professional edition.
Could you kindly look into the problem, and help us to solve it?
Thanks in advance!
Original comment by [email protected]
on 29 Jun 2010 at 6:37
from qizmt.
You mention formatting with hosts shark01 and shark02, but the error message is
about host shark04. Be sure that you are not calling a previous install of
Qizmt and that you formatted with the correct hosts. Also, ensure that Qizmt is
installed in the same local directory on all hosts, e.g. on host1 c:\Qizmt\ and
on host2 c:\Qizmt\
Original comment by MillerChristopherE
on 30 Jun 2010 at 2:59
from qizmt.
Hi, Chris, sorry for making you confused. I do formated shark04, in the message
there, I wanted to tell you that, the format is successful, but it still does
not work. By the way, I do installed in the same directory in all the hosts,
and the OS is windows 7 professional edition. Any idea about the solution?
Thanks again for your taking time to look into the problem! Happy holiday!
Original comment by [email protected]
on 2 Jul 2010 at 11:37
from qizmt.
Today, when I test, got the following error message
Could you let me know how to solve the problem? Thanks in advance!
C:\>qizmt exec For_Peter.xml
Job Identifier: 378
[7/13/2010 6:37:30 PM] [MapReduce: Job Processing: get unique lower level
category - upper level category ID pairs]
Legend: m = map done; e = exchange done; s = sort done; r = reduce done
4 processes on 1 machines:
(1000 * max((1769321 / 12) / (10737418240 / 12), 1)) = 1000
ffff
[7/13/2010 6:37:34 PM] Distribution index done; starting map
mmmm
[7/13/2010 6:37:38 PM] Map done; starting map exchange
eeee[exchange completed 00:00:01].ssss[sort completed 00:00:11]rrrr
[7/13/2010 6:37:43 PM] Done
Output: dfs://job_01_output.txt
Duration: 00:00:13
[7/13/2010 6:37:43 PM] [MapReduce: Job Processing: get upper level catego
ry ID - keyword pair ]
Legend: m = map done; e = exchange done; s = sort done; r = reduce done
5 processes on 1 machines:
................................................................................
.m.mm.m....m
[7/13/2010 6:52:18 PM] Map done; starting map exchange
..........................ee..e.e....s.s...s.s.......r........r...r..r..........
............e[exchange completed 00:13:25](split).Thread exception: (exchange th
read) System.Exception: SortBlocks error: Sub process 0 did not return a valid r
esponse
at MySpace.DataMining.DistributedObjects5.ArrayComboList.SortBlocks()
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.InZBlocks() in C:\Si
mpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 133
at MySpace.DataMining.AELight.AELight.MapReduceBlockInfo.exchangethreadproc()
in C:\SimpleSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:l
ine 958
Split count: 1
[7/13/2010 7:05:41 PM 802ms] \\Shark01 DistributedObjectsSlave error: (build:368
6.29033) Problem loading remote zMapBlock '\\localhost\C$\Users\MapReduce\MapRed
uce\zmap_0_a60bbad1-6e8b-4e21-a896-9abaf0ffc8fa.j378.zm': System.Exception: Insu
fficient resources for this job on cluster (ZBlock value file size > ZVALUEBLOCK
_LIMIT) (consider increasing sub process count)
at MySpace.DataMining.DistributedObjects5.ArrayComboListPart.ZBlock.Add(Byte[
] keybuf, Int32 keyoffset, Byte[] valuebuf, Int32 valueoffset, Int32 valuelength
) in C:\SimpleSolutions\DataMining\DistributedObjects5\MySpace.DataMining.Distri
butedObjects.DistributedObjectsSlave\ArrayComboListSlave.cs:line 340
at MySpace.DataMining.DistributedObjects5.ArrayComboListPart.ZMapStreamToZBlo
cks(Stream stm, Int64 len, String sfn, Int32 iFILE_BUFFER_SIZE, Boolean bcompres
szmaps) in C:\SimpleSolutions\DataMining\DistributedObjects5\MySpace.DataMining.
DistributedObjects.DistributedObjectsSlave\ArrayComboListSlave.cs:line 5378
at MySpace.DataMining.DistributedObjects5.ArrayComboListPart.ProcessCommand(N
etworkStream nstm, Char tag) in C:\SimpleSolutions\DataMining\DistributedObjects
5\MySpace.DataMining.DistributedObjects.DistributedObjectsSlave\ArrayComboListSl
ave.cs:line 5129
----------------------------------------------------------------
System.NullReferenceException: Object reference not set to an instance of an obj
ect.
at MySpace.DataMining.AELight.AELight._ExecOneMapReduce(String ExecOpts, Job
cfgj, String[] ExecArgs, Boolean verbose, Boolean verbosereplication, List`1 Add
CacheNodes, List`1 AddCacheDfsFileNames, List`1 AddCacheNodesOffsets, List`1 Add
CacheNodesRecLengths) in C:\SimpleSolutions\DataMining\DistributedObjects5\AELig
ht\ExecMapReduce.cs:line 2477
at MySpace.DataMining.AELight.AELight.ExecOneMapReduce(String ExecOpts, Job c
fgj, String[] ExecArgs, Boolean verbose, Boolean verbosereplication) in C:\Simpl
eSolutions\DataMining\DistributedObjects5\AELight\ExecMapReduce.cs:line 1473
at MySpace.DataMining.AELight.AELight.Exec(String ExecOpts, SourceCode cfg, S
tring[] ExecArgs, Boolean verbose, Boolean verbosereplication) in C:\SimpleSolut
ions\DataMining\DistributedObjects5\AELight\AELight.cs:line 421
at MySpace.DataMining.AELight.AELight.Exec(String ExecOpts, SourceCode cfg, S
tring[] ExecArgs, Boolean verbose) in C:\SimpleSolutions\DataMining\DistributedO
bjects5\AELight\AELight.cs:line 471
at MySpace.DataMining.AELight.AELight.AELightRun(String[] args) in C:\SimpleS
olutions\DataMining\DistributedObjects5\AELight\AELight.cs:line 3026
C:\>
Original comment by [email protected]
on 14 Jul 2010 at 2:12
from qizmt.
The relevant part of this error message is "System.Exception: Insufficient
resources for this job on cluster (ZBlock value file size > ZVALUEBLOCK_LIMIT)
(consider increasing sub process count)"
and it means too much data is going to one intermediate data file.
This is addressed in the FAQ at
http://code.google.com/p/qizmt/wiki/MySpaceQizmtFAQTroubleshoot#System.Exception
:Insufficient_resources_for_this_job_on_cluster
One solution is to use the IntermediateDataAddressing tag in your job as
explained at
http://code.google.com/p/qizmt/wiki/MySpaceQizmtReferenceIntermediateDataAddress
ing
this will simply allow more data to go into one intermediate data file.
Original comment by MillerChristopherE
on 20 Jul 2010 at 1:28
from qizmt.
Original comment by [email protected]
on 21 Dec 2010 at 3:06
- Changed state: Duplicate
from qizmt.
Related Issues (17)
- AELight Exception HOT 9
- Is there any kind of online forum for qizmt? HOT 4
- Exception resulting from username and password combination during install HOT 3
- On vista x64 msi installer either crashes or cannot find accounts HOT 1
- Current version does't build HOT 2
- Getting Error 1001 No mappings between accountnames and security ids were done HOT 1
- Installation problem Error 1001. user name password HOT 3
- RDBMS_qa tools to query very slow,why???? HOT 2
- memcache create succeeded, how to use the jobs? HOT 2
- C# qizmt mapreduce engine is very powerful,Thank you for your team and hopes to continue developing this project HOT 2
- Different server configurations, Qizmt workload assigned to them the same? HOT 2
- error while setup HOT 2
- No Master Node
- 2 large Dataset comparison
- This project is no longer updated, it is dead??? HOT 2
- error: Problem with network files (create)1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qizmt.