Comments (21)
@JafferWilson
Please copy the following code instead of the one given here for module load_bin_vec(fname,vocab). This should resolve the issue.
def load_bin_vec(fname, vocab):
"""
Loads 300x1 word vecs from Google (Mikolov) word2vec
"""
word_vecs = {}
with open(fname, "rb") as f:
header = f.readline()
vocab_size, layer1_size = map(int, header.split())
binary_len = np.dtype(theano.config.floatX).itemsize * layer1_size
for line in xrange(vocab_size):
word = []
ch = f.read(1)
if ch == ' ':
word = ''.join(word)
break
if ch != '\n':
word.append(ch)
if tuple(word) in vocab:
word_vecs[tuple(word)] = np.fromstring(f.read(binary_len), dtype=theano.config.floatX)
else:
f.read(binary_len)
return word_vecs
from personality-detection.
Here is the file attached in txt format. Please convert this to python script. No new system requirements needed except the ones already mentioned in the README.
process_data.txt
from personality-detection.
I increased the RAM to 480 GB.. still the pre-process show process killed.
Is it possible for you to make the pre-processed data available in the repository?
from personality-detection.
Can you please answer my queries, it will help for sure. Waiting for your reply.
from personality-detection.
I confirm the issue.
@JafferWilson did you find a way to make it run?
from personality-detection.
@fievelk Yes. The way it is shown in the Read.me file. It is the same way I ran the code.
from personality-detection.
@JafferWilson Sorry, I did not formulate my question correctly. Running the code using the instructions in the README still produces these memory issues and the process gets killed.
Did you manage to fix the problem somehow?
from personality-detection.
@fievelk Well No... I do not understand why the process is taking so much of Memory. As I have mentioned in the issues what experiment I did and still empty handed.
from personality-detection.
dear @JafferWilson can you slove the problem by using this code?
from personality-detection.
@naikzinal Sure I will. Just having another problems to solve. As soon free I will.
from personality-detection.
" name 'load_bin_vec' is not defined"
i found that error after changing code can you please help me
thank you
from personality-detection.
from personality-detection.
dear,@chaisme i solved my naming error but, i still have a memory issue. and i don't get any attachment from you. if you are able to run code then can you please send me your process_data.py file. if you can please send me. and what system requirement is needed for run this code?
thank you
from personality-detection.
dear @chaisme ,Thank you for rly. i will try as soon as i can. and here is my eamil_id [email protected] you can mail me on that id.
thank you
from personality-detection.
@naikzinal Why you want it on your email, where as you can download it from here always? Or you can download it now and then upload it on your side.
from personality-detection.
@naikzinal @JafferWilson I have uploaded the txt file in the above comment. Use it as a python script.
from personality-detection.
dear @JafferWilson actually i changed the code bt still i have memory isseue thats why i asked for file.now i can run my code.
from personality-detection.
Initially showed process killed but ran perfectly using the code of @chaisme . Thank you very much.
from personality-detection.
Hi there,
I am trying to run this app and I seem to get stuck at the training phase:
python conv_net_train.py -static -word2vec 2
loading data... data loaded!
model architecture: CNN-static
using: word2vec vectors
[('image shape', 153, 300), ('filter shape', [(200, 1, 1, 300), (200, 1, 2, 300), (200, 1, 3, 300)]), ('hidden_units', [200, 200, 2]), ('dropout', [0.5, 0.5, 0.5]), ('batch_size', 50), ('non_static', False), ('learn_decay', 0.95), ('conv_non_linear', 'relu'), ('non_static', False), ('sqr_norm_lim', 9), ('shuffle_batch', True)]
... training
When I interrupt the kernel I get:
Traceback (most recent call last):
File "conv_net_train.py", line 476, in <module>
activations=[Sigmoid])
File "conv_net_train.py", line 221, in train_conv_net
cost_epoch = train_model(minibatch_index)
File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/compile/function_module.py", line 903, in __call__
self.fn() if output_subset is None else\
File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 963, in rval
r = p(n, [x[0] for x in i], o)
File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 952, in p
self, node)
File "theano/scan_module/scan_perform.pyx", line 397, in theano.scan_module.scan_perform.perform (/Users/jennan/.theano/compiledir_Darwin-16.7.0-x86_64-i386-64bit-i386-2.7.15-64/scan_perform/mod.cpp:4490)
File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 961, in rval
def rval(p=p, i=node_input_storage, o=node_output_storage, n=node,
KeyboardInterrupt
Any help would be greatly appreciated!!
from personality-detection.
File "conv_net_train.py", line 147, in train_conv_net
train_set_x = datasets[0][rand_perm]
MemoryError
Please someone help I need the soln asap
from personality-detection.
Hi there,
I am trying to run this app and I seem to get stuck at the training phase:
python conv_net_train.py -static -word2vec 2 loading data... data loaded! model architecture: CNN-static using: word2vec vectors [('image shape', 153, 300), ('filter shape', [(200, 1, 1, 300), (200, 1, 2, 300), (200, 1, 3, 300)]), ('hidden_units', [200, 200, 2]), ('dropout', [0.5, 0.5, 0.5]), ('batch_size', 50), ('non_static', False), ('learn_decay', 0.95), ('conv_non_linear', 'relu'), ('non_static', False), ('sqr_norm_lim', 9), ('shuffle_batch', True)] ... training
When I interrupt the kernel I get:
Traceback (most recent call last): File "conv_net_train.py", line 476, in <module> activations=[Sigmoid]) File "conv_net_train.py", line 221, in train_conv_net cost_epoch = train_model(minibatch_index) File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/compile/function_module.py", line 903, in __call__ self.fn() if output_subset is None else\ File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 963, in rval r = p(n, [x[0] for x in i], o) File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 952, in p self, node) File "theano/scan_module/scan_perform.pyx", line 397, in theano.scan_module.scan_perform.perform (/Users/jennan/.theano/compiledir_Darwin-16.7.0-x86_64-i386-64bit-i386-2.7.15-64/scan_perform/mod.cpp:4490) File "/anaconda3/envs/py27/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 961, in rval def rval(p=p, i=node_input_storage, o=node_output_storage, n=node, KeyboardInterrupt
Any help would be greatly appreciated!!
Same here. Anyone regarding this, your recommendation would be highly appreciated.
from personality-detection.
Related Issues (20)
- how get mairesse file HOT 2
- could not decrease loss function
- Preprocessing Never Terminating
- process_data.py运行最后报memoryError,我是8G,怎么解决?
- Process_data.py run error, display memoryError, I use win10, 8G memory, how to solve? HOT 6
- What should be the input data for test?
- How to run this project please send step by step
- naming conventions in the code. HOT 1
- Will you create a Python 3 version of this? Thank you! HOT 3
- Test Data HOT 1
- 'function' object has no attribute 'func_name' HOT 3
- Python 3 HOT 45
- TypeError: Cannot convert Type TensorType(float64, matrix) (of Variable Subtensor{int64:int64:}.0) into Type TensorType(float32, matrix). You can try to manually convert Subtensor{int64:int64:}.0 into a TensorType(float32, matrix). HOT 2
- Unable to configure cpu
- Issue with executing conv_net_train.py HOT 31
- process_data.py with GoogleNews-vectors-negative300.bin.gz file HOT 1
- TypeError: expected str, bytes or os.PathLike object, not Word2VecKeyedVectors while loading GoogleNews-vectors-negative300-SLIM.bin file
- How to use the trained model to predict the personality score? HOT 1
- MemoryError: Apply node that caused the error: AdvancedSubtensor1(Words, Elemwise{Cast{int32}}.0) HOT 1
- #include<iostream> #include
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from personality-detection.