2016-10-25 21 views
0

私は--test_with_fake_dataを使用して実行するとき、すべてがOKである、char-level text classification exampleを実行するつもりです:それはコードと環境が健康であることを意味'text_classification_character_cnn.py'の例を1つのGPUで実行することはできますか?

$ python text_classification_character_cnn.py --test_with_fake_data 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcublas.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcudnn.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcufft.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcuda.so.1 locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcurand.so locally 
WARNING:tensorflow:Using temporary folder as model directory: /tmp/tmpJCDcsa 
WARNING:tensorflow:Setting feature info to TensorSignature(dtype=tf.float32, shape=TensorShape([Dimension(None), Dimension(100)]), is_sparse=False) 
WARNING:tensorflow:Setting targets info to TensorSignature(dtype=tf.int32, shape=TensorShape([Dimension(None)]), is_sparse=False) 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:102] Found device 0 with properties: 
name: GeForce GTX TITAN X 
major: 5 minor: 2 memoryClockRate (GHz) 1.076 
pciBusID 0000:02:00.0 
Total memory: 12.00GiB 
Free memory: 11.87GiB 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:126] DMA: 0 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:136] 0: Y 
I tensorflow/core/common_runtime/gpu/gpu_device.cc:839] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX TITAN X, pci bus id: 0000:02:00.0) 
I tensorflow/core/common_runtime/gpu/gpu_device.cc:839] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX TITAN X, pci bus id: 0000:02:00.0) 
Accuracy: 1.000000 

。 DBpediaのデータセットで実行:

$ python text_classification_character_cnn.py      
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcublas.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcudnn.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcufft.so locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcuda.so.1 locally 
I tensorflow/stream_executor/dso_loader.cc:108] successfully opened CUDA library libcurand.so locally 
WARNING:tensorflow:Using temporary folder as model directory: /tmp/tmpcMgfxe 
WARNING:tensorflow:Setting feature info to TensorSignature(dtype=tf.float32, shape=TensorShape([Dimension(None), Dimension(100)]), is_sparse=False) 
WARNING:tensorflow:Setting targets info to TensorSignature(dtype=tf.int32, shape=TensorShape([Dimension(None)]), is_sparse=False) 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:102] Found device 0 with properties: 
name: GeForce GTX TITAN X 
major: 5 minor: 2 memoryClockRate (GHz) 1.076 
pciBusID 0000:02:00.0 
Total memory: 12.00GiB 
Free memory: 11.87GiB 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:126] DMA: 0 
I tensorflow/core/common_runtime/gpu/gpu_init.cc:136] 0: Y 
I tensorflow/core/common_runtime/gpu/gpu_device.cc:839] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX TITAN X, pci bus id: 0000:02:00.0) 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (256): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (512): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (1024): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (2048): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (4096): Total Chunks: 1, Chunks in use: 0 7.0KiB allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (8192): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (16384): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (32768): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (65536): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (131072): Total Chunks: 1, Chunks in use: 0 200.0KiB allocated for chunks. 200.0KiB client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (262144): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (524288): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (1048576): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (2097152): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (4194304): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (8388608): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (16777216): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (33554432): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (67108864): Total Chunks: 0, Chunks in use: 0 0B allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (134217728): Total Chunks: 1, Chunks in use: 0 213.62MiB allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:639] Bin (268435456): Total Chunks: 1, Chunks in use: 0 10.62GiB allocated for chunks. 0B client-requested for chunks. 0B in use in bin. 0B client-requested in use in bin. 
I tensorflow/core/common_runtime/bfc_allocator.cc:656] Bin for 53.41GiB was 256.00MiB, Chunk State: 
I tensorflow/core/common_runtime/bfc_allocator.cc:662] Size: 10.62GiB | Requested Size: 0B | in_use: 0, prev: Size: 427.25MiB | Requested Size: 427.25MiB | in_use: 1 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80000 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80100 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80200 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80300 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80400 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80500 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80600 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80700 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80800 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80900 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06d80a00 of size 204800 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db2a00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db2b00 of size 8192 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db4b00 of size 768 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db4e00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db4f00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db5000 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db5100 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06db5200 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de7300 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de7400 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de7500 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de7600 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de7700 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9400 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9500 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9600 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9700 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9800 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9900 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9a00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9b00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06de9c00 of size 204800 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e1bc00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e1bd00 of size 204800 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4dd00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4de00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4df00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4e000 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4e100 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e4e200 of size 204800 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e80200 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e80300 of size 8192 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e82300 of size 8192 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e84300 of size 768 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e84600 of size 768 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e84900 of size 8192 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e86900 of size 768 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e86c00 of size 256 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb06e86d00 of size 33600000 
I tensorflow/core/common_runtime/bfc_allocator.cc:674] Chunk at 0xb16431700 of size 448000000 
I tensorflow/core/common_runtime/bfc_allocator.cc:683] Free at 0xb06db5300 of size 204800 
I tensorflow/core/common_runtime/bfc_allocator.cc:683] Free at 0xb06de7800 of size 7168 
I tensorflow/core/common_runtime/bfc_allocator.cc:683] Free at 0xb08e91f00 of size 224000000 
I tensorflow/core/common_runtime/bfc_allocator.cc:683] Free at 0xb30f70700 of size 11399076352 
I tensorflow/core/common_runtime/bfc_allocator.cc:689]  Summary of in-use Chunks by size: 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 37 Chunks of size 256 totalling 9.2KiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 4 Chunks of size 768 totalling 3.0KiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 4 Chunks of size 8192 totalling 32.0KiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 4 Chunks of size 204800 totalling 800.0KiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 1 Chunks of size 33600000 totalling 32.04MiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:692] 1 Chunks of size 448000000 totalling 427.25MiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:696] Sum Total of in-use chunks: 460.11MiB 
I tensorflow/core/common_runtime/bfc_allocator.cc:698] Stats: 
Limit:     12105752781 
InUse:     482464512 
MaxInUse:    706464512 
NumAllocs:      67 
MaxAllocSize:   448000000 
W tensorflow/core/common_runtime/bfc_allocator.cc:271] Ran out of memory trying to allocate 53.41GiB. See logs for memory state. 

TensorFlowは、誰もがこの例を実行中に実験を持っている場合は、私を助けてくださいタイタンXには使用できません53.41GiBメモリを必要とするようです。 classificaiton例で

答えて

3

線102

classifier.fit(x_train, y_train, steps=100) 

フィット()メソッドは、オプションBATCH_SIZE引数を取ります。 デフォルトでは、x_trainのサンプル数になります。

batch_size = 16に設定し、必要なメモリ量を確認してください。 助けがあれば、バッチサイズは、 の訓練速度が増え、GPUに合う限り増やしてください。

関連する問題