The distributed statistical machine translation infrastructure consisting of load balancing, text pre/post-processing and translation services. Written in C++ 11 and utilises multicore CPUs by employing multi-threading, allows for secure SSL/TLS communications.
License: GNU General Public License v2.0
When running the tuning script, I get some errors in the logs and the tuning script appears to fail.
The commands I'm running (with seemingly unnecessary bits truncated) is:
$ cd tuning
$ ls
forums.en.1 forums.fr server.cfg
$ ~/Distributed-Translation-Infrastructure/script/tuning/run_tuning.pl --conf=server.cfg --src-language=French --src=/home/bakerj/tuning/forums.fr --ref=/home/bakerj/tuning/forums.en --trg-language=English --trace=3
...
$ ~/Distributed-Translation-Infrastructure/script/tuning/tuning_progress.pl --conf=server.cfg --err=tuning.log
Smartmatch is experimental at /home/bakerj/Distributed-Translation-Infrastructure/script/tuning/tuning_progress.pl line 124.
ERROR: Can't open file .server.cfg.work.feature_id2name: No such file or directory
$ cat tuning.log
tuner.pl pid=67560
readline() on closed filehandle FEATURES_MAPPING_FILE at /home/bakerj/Distributed-Translation-Infrastructure/script/tuning/scripts/load_config_file.pl line 172.
/home/bakerj/Distributed-Translation-Infrastructure/script/tuning/scripts/../PRO/PRO-optimization-procedure.pl ... --lambda-string='' ...
Option lambda-string requires an argument
...
The server cannot parse the config file properly when lambda values are in high precision. Here I have provided some lambda values to be used in a config file. The order of the lambda values is the same order as in server.cfg.feature_id2name file.
-0.000162457848383319 0.247927209374343 0.0355422983635898 0.0148346801128702 0.00169563839872649 -0.00867862339385234 0.015074386107116 0.0133560971821781 0.0189869657925356 0.0329663066094344 0.01456172599588 0.00776403068125194 0.037211847543291 0.0571065223939
879 0.0506461063759449 0.0024456905316676
When trying to run the servers as a service, the logs quickly get filled up with > symbols, which I assume is from the input prompt. An example script for creating and starting a service demonstrating this (on Ubuntu):
cat > /etc/systemd/system/mt-processor.service <<EOL
[Unit]
Description=MT Processor
[Service]
User=ec2-user
ExecStart=/opt/bin/bpbd-processor -c /opt/conf/processor.cfg
WorkingDirectory=/home/ec2-user
[Install]
WantedBy=multi-user.target
EOL
# Install and start service
sudo systemctl daemon-reload
sudo systemctl enable mt-processor
sudo systemctl start mt-processor
After a week or so, my disk is full up and when looking at what is taking up all the space I find it is /var/log/messages which is full of lines such as:
May 31 12:53:26 ip-10-2-3-171 bpbd-processor: >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >>
Is it possible to modify so that it is suitable for running as a service? This happens for all three types of server.
In the example configuration, it states:
#Defines the temporary DH (Diffie-Hellman) parameters file name (*.pem)
#Example method of generating this file:
# openssl dhparam -out dh.pem 2048
#The DH parameter size is to be chosen as follows:
# Mozilla Old - suggests 1024 as the minimum size to use, using
# smaller size will cause TLS handshake failure!
# Mozilla Intermediate - suggests 2048 as the minimum size to use
# Mozilla Modern - suggests not using DH at all but we still allow
#May be left empty for 'is_tls_server=false'
tls_tmp_dh_file=./certificates/dh2048.pem
To me, that suggests I should be able to leave tls_tmp_dh_file if I'm using Mozilla Modern. However, if I set tls_mode=mod (i.e. using Mozilla Modern) and then don't set the value I get the following:
ERROR <bpbd_processor.cpp::main(...):214>: main.hpp:131: Undefined compulsory '[Server Options]/tls_tmp_dh_file' (section/key) value in the configuration file!
If I'm using Mozilla Modern, and not using DH, do I still need to set the configuration? And if not, is it a bug that a value is still required?
I don't know how difficult this would be, but it would be a useful feature to be able to dynamically update/reload the load balancer configuration so that new servers can be added or removed.
The use case to this is an auto-scaling translation server farm, where new servers are added and removed as required to handle a variable volume of data. At the moment, as far as I can see, this would require the load balancer to be restarted with an updated configuration file which obviously isn't ideal and may result in queries being lost.
I'm trying to compile the software on Ubuntu 16.04.3, but the instructions provided in the README don't work.
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure$ mkdir build
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure$ cd build/
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure/build$ cmake -DCMAKE_BUILD_TYPE=Release ..
-- The C compiler identification is GNU 5.4.0
-- The CXX compiler identification is GNU 5.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bakerj/Distributed-Translation-Infrastructure/build
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure/build$ make VERBOSE=1
/usr/bin/cmake -H/home/bakerj/Distributed-Translation-Infrastructure -B/home/bakerj/Distributed-Translation-Infrastructure/build --check-build-system CMakeFiles/Makefile.cmake 0
/usr/bin/cmake -E cmake_progress_start /home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles /home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/progress.marks
make -f CMakeFiles/Makefile2 all
make[1]: Entering directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
make -f CMakeFiles/bpbd-client.dir/build.make CMakeFiles/bpbd-client.dir/depend
make[2]: Entering directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
cd /home/bakerj/Distributed-Translation-Infrastructure/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/bakerj/Distributed-Translation-Infrastructure /home/bakerj/Distributed-Translation-Infrastructure /home/bakerj/Distributed-Translation-Infrastructure/build /home/bakerj/Distributed-Translation-Infrastructure/build /home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/bpbd-client.dir/DependInfo.cmake --color=
Dependee "/home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/bpbd-client.dir/DependInfo.cmake" is newer than depender "/home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/bpbd-client.dir/depend.internal".
Dependee "/home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/CMakeDirectoryInformation.cmake" is newer than depender "/home/bakerj/Distributed-Translation-Infrastructure/build/CMakeFiles/bpbd-client.dir/depend.internal".
Scanning dependencies of target bpbd-client
make[2]: Leaving directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
make -f CMakeFiles/bpbd-client.dir/build.make CMakeFiles/bpbd-client.dir/build
make[2]: Entering directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
[ 1%] Building CXX object CMakeFiles/bpbd-client.dir/src/client/bpbd_client.cpp.o
/usr/bin/c++ -I/home/bakerj/Distributed-Translation-Infrastructure/inc -isystem /home/bakerj/Distributed-Translation-Infrastructure/ext -pipe -std=c++0x -Wall -m64 -O3 -DNDEBUG -o CMakeFiles/bpbd-client.dir/src/client/bpbd_client.cpp.o -c /home/bakerj/Distributed-Translation-Infrastructure/src/client/bpbd_client.cpp
[ 2%] Building CXX object CMakeFiles/bpbd-client.dir/src/common/messaging/trans_job_code.cpp.o
/usr/bin/c++ -I/home/bakerj/Distributed-Translation-Infrastructure/inc -isystem /home/bakerj/Distributed-Translation-Infrastructure/ext -pipe -std=c++0x -Wall -m64 -O3 -DNDEBUG -o CMakeFiles/bpbd-client.dir/src/common/messaging/trans_job_code.cpp.o -c /home/bakerj/Distributed-Translation-Infrastructure/src/common/messaging/trans_job_code.cpp
In file included from /home/bakerj/Distributed-Translation-Infrastructure/inc/common/utils/exceptions.hpp:31:0,
from /home/bakerj/Distributed-Translation-Infrastructure/inc/common/messaging/status_code.hpp:32,
from /home/bakerj/Distributed-Translation-Infrastructure/src/common/messaging/trans_job_code.cpp:26:
/home/bakerj/Distributed-Translation-Infrastructure/inc/common/utils/logging/logger.hpp: In static member function ‘static void uva::utils::logging::logger::get_reporting_levels(std::vector<std::__cxx11::basic_string<char> >*)’:
/home/bakerj/Distributed-Translation-Infrastructure/inc/common/utils/logging/logger.hpp:159:87: error: ‘transform’ was not declared in this scope
transform(level.begin(), level.end(), level.begin(), ::tolower);
^
/home/bakerj/Distributed-Translation-Infrastructure/inc/common/utils/logging/logger.hpp: In static member function ‘static void uva::utils::logging::logger::set_reporting_level(std::__cxx11::string)’:
/home/bakerj/Distributed-Translation-Infrastructure/inc/common/utils/logging/logger.hpp:175:83: error: ‘transform’ was not declared in this scope
transform(level.begin(), level.end(), level.begin(), ::toupper);
^
CMakeFiles/bpbd-client.dir/build.make:86: recipe for target 'CMakeFiles/bpbd-client.dir/src/common/messaging/trans_job_code.cpp.o' failed
make[2]: *** [CMakeFiles/bpbd-client.dir/src/common/messaging/trans_job_code.cpp.o] Error 1
make[2]: Leaving directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/bpbd-client.dir/all' failed
make[1]: *** [CMakeFiles/bpbd-client.dir/all] Error 2
make[1]: Leaving directory '/home/bakerj/Distributed-Translation-Infrastructure/build'
Makefile:83: recipe for target 'all' failed
make: *** [all] Error 2
I'm using the following versions:
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure$ gcc --version
gcc (Ubuntu 5.4.0-6ubuntu1~16.04.6) 5.4.0 20160609
Copyright (C) 2015 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
bakerj@bakerj-Z6:~/Distributed-Translation-Infrastructure$ cmake --version
cmake version 3.5.1
This is with the latest commit on the master branch. The released version of the code (1.7) does build correctly.
I think it's not a bad idea to mention in the documentation that the decoder doesn't accept compressed model files. Because the default is that people use compressed model files with other decoders.
In the documentation it has been mentioned that one has to set LOGER_M_GRAM_LEVEL_MAX constant value in the ./inc/common/utils/logging/logger.hpp header file to change the log level, while the mentioned constant does not exist in the hpp file and the constant name seems to be MAXIMUM_LOGGING_LEVEL.
Building and running demo on Amazon AWS with AMI linux VM, Running bpbd-client to send test file to demo system I get:
USAGE: The requested debug level is: 'INFO3', the maximum build level is 'INFO3' the set level is 'INFO3'
USAGE: Loading the server configuration option from: ../demo/tls/configs/client-no-tls.cfg
INFO: Translation client parameters: { source file = /home/ec2-user/test.zh, source language = German, target file = /home/ec2-user/test.en, target language = english, pre-processor server = WebSocket client parameters: {server_uri = ws://localhost:9004, is_tls_client = false}, translation server = WebSocket client parameters: {server_uri = ws://localhost:9007, is_tls_client = false}, post-processor server = WebSocket client parameters: {server_uri = ws://localhost:9004, is_tls_client = false}, min sentences per request = 100, max sentences per request = 200, request priority = 0, translation info = OFF }
INFO3: Sanity checks are: OFF !
USAGE: Using the <cstyle_file_reader.hpp> file reader!
USAGE: Reading source text from '/home/ec2-user/test.zh'
USAGE: Starting the pre-processor process ...
INFO1: Attempting to connect to the server!
INFO: Starting creating and sending out pre-processor jobs!
USAGE: Waiting for the pre-processor process to finish ...
INFO1: The processor job request chunk 1/1 is sent.
INFO: Sent out 1 pre-processor jobs, waiting for results.
ERROR <incoming_msg.hpp::de_serialize(...):79>: An exception when parsing JSON string: incoming_msg.hpp::de_serialize(...):77: JSON parse error: 3
ERROR <incoming_msg.hpp::de_serialize(...):80>: Received JSON message data: websocket_server.hpp::pre_process_request(...):360: This functionality is not supported!
ERROR <websocket_client_base.hpp::on_message(...):273>: incoming_msg.hpp::de_serialize(...):81: incoming_msg.hpp::de_serialize(...):77: JSON parse error: 3
Compilation executed with no issue detected. Seems to only affect bbd-processor (balancer and server run ok)
I've not had this problem on previous builds so I am guessing there is some dependency change
When trying to build the new REMEDI 1.8.1 release, I get the following:
bakerj@z6-den:~/REMEDI-1.8.1$ mkdir build
bakerj@z6-den:~/REMEDI-1.8.1$ cd build
bakerj@z6-den:~/REMEDI-1.8.1/build$ cmake -DCMAKE_BUILD_TYPE=Release -DWITH_TLS=true ..
-- The C compiler identification is GNU 7.3.0
-- The CXX compiler identification is GNU 7.3.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- TLS support is ENABLED
-- Found OpenSSL: /usr/lib/x86_64-linux-gnu/libcrypto.so (found version "1.1.0g")
-- OpenSSL include dir: '/usr/include'
-- OpenSSL libraries: '/usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so'
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bakerj/REMEDI-1.8.1/build
bakerj@z6-den:~/REMEDI-1.8.1/build$ make
Scanning dependencies of target bpbd-server
[ 1%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/server_parameters.cpp.o
[ 2%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/decoder/de_parameters.cpp.o
[ 4%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/decoder/de_configurator.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/stack/multi_stack.hpp:38,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/sentence/sentence_decoder.hpp:41,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/de_configurator.hpp:30,
from /home/bakerj/REMEDI-1.8.1/src/server/decoder/de_configurator.cpp:26:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 5%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/lm_parameters.cpp.o
[ 6%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/tm/tm_parameters.cpp.o
[ 8%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/rm/rm_parameters.cpp.o
[ 9%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/rm/models/rm_entry.cpp.o
[ 10%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/lm_configurator.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/src/server/lm/lm_configurator.cpp:26:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 12%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/tm/tm_configurator.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/builders/tm_basic_builder.hpp:45,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/tm_configs.hpp:36,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/proxy/tm_query_proxy.hpp:29,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/proxy/tm_proxy.hpp:29,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/tm_configurator.hpp:33,
from /home/bakerj/REMEDI-1.8.1/src/server/tm/tm_configurator.cpp:26:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 13%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/rm/rm_configurator.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/builders/tm_basic_builder.hpp:45,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/tm_configs.hpp:36,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/proxy/tm_query_proxy.hpp:29,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/proxy/tm_proxy.hpp:29,
from /home/bakerj/REMEDI-1.8.1/inc/server/tm/tm_configurator.hpp:33,
from /home/bakerj/REMEDI-1.8.1/inc/server/rm/builders/rm_basic_builder.hpp:36,
from /home/bakerj/REMEDI-1.8.1/inc/server/rm/rm_configs.hpp:36,
from /home/bakerj/REMEDI-1.8.1/inc/server/rm/proxy/rm_proxy_local.hpp:34,
from /home/bakerj/REMEDI-1.8.1/inc/server/rm/rm_configurator.hpp:34,
from /home/bakerj/REMEDI-1.8.1/src/server/rm/rm_configurator.cpp:26:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 15%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/tm/models/tm_target_entry.cpp.o
[ 16%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/m_gram_query.cpp.o
[ 17%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/w2c_hybrid_trie.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/src/server/lm/models/w2c_hybrid_trie.cpp:25:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 19%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/w2c_array_trie.cpp.o
[ 20%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/h2d_map_trie.cpp.o
[ 21%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/g2d_map_trie.cpp.o
[ 23%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/c2w_array_trie.cpp.o
[ 24%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/c2d_map_trie.cpp.o
[ 26%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/models/c2d_hybrid_trie.cpp.o
[ 27%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/mgrams/query_m_gram.cpp.o
[ 28%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/mgrams/model_m_gram.cpp.o
[ 30%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/mgrams/byte_m_gram_id.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/src/server/lm/mgrams/byte_m_gram_id.cpp:31:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 31%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/builders/lm_basic_builder.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/builders/lm_gram_builder_factory.hpp:37,
from /home/bakerj/REMEDI-1.8.1/src/server/lm/builders/lm_basic_builder.cpp:36:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 32%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/lm/builders/lm_gram_builder.cpp.o
[ 34%] Building CXX object CMakeFiles/bpbd-server.dir/src/common/messaging/websocket/websocket_server_params.cpp.o
[ 35%] Building CXX object CMakeFiles/bpbd-server.dir/src/common/messaging/trans_job_code.cpp.o
[ 36%] Building CXX object CMakeFiles/bpbd-server.dir/src/common/messaging/messaging.cpp.o
[ 38%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/messaging/messaging.cpp.o
[ 39%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/trans_task.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/stack/multi_stack.hpp:38,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/sentence/sentence_decoder.hpp:41,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/de_configurator.hpp:30,
from /home/bakerj/REMEDI-1.8.1/inc/server/trans_task.hpp:41,
from /home/bakerj/REMEDI-1.8.1/src/server/trans_task.cpp:26:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
[ 41%] Building CXX object CMakeFiles/bpbd-server.dir/src/server/bpbd_server.cpp.o
In file included from /home/bakerj/REMEDI-1.8.1/ext/websocketpp/config/asio.hpp:33:0,
from /home/bakerj/REMEDI-1.8.1/inc/common/messaging/websocket/server_hs_with_tls.hpp:37,
from /home/bakerj/REMEDI-1.8.1/inc/common/messaging/websocket/websocket_server.hpp:49,
from /home/bakerj/REMEDI-1.8.1/inc/server/translation_server.hpp:29,
from /home/bakerj/REMEDI-1.8.1/src/server/bpbd_server.cpp:46:
/home/bakerj/REMEDI-1.8.1/ext/websocketpp/transport/asio/security/tls.hpp: In member function ‘std::error_code websocketpp::transport::asio::tls_socket::connection::translate_ec(ErrorCodeType)’:
/home/bakerj/REMEDI-1.8.1/ext/websocketpp/transport/asio/security/tls.hpp:358:47: error: ‘SSL_R_SHORT_READ’ was not declared in this scope
if (ERR_GET_REASON(ec.value()) == SSL_R_SHORT_READ) {
^~~~~~~~~~~~~~~~
/home/bakerj/REMEDI-1.8.1/ext/websocketpp/transport/asio/security/tls.hpp:358:47: note: suggested alternative: ‘SSL_F_SSL_READ’
if (ERR_GET_REASON(ec.value()) == SSL_R_SHORT_READ) {
^~~~~~~~~~~~~~~~
SSL_F_SSL_READ
In file included from /home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2c_hybrid_trie.hpp:38:0,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configs.hpp:51,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/proxy/lm_proxy_local.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/lm/lm_configurator.hpp:35,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/stack/multi_stack.hpp:38,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/sentence/sentence_decoder.hpp:41,
from /home/bakerj/REMEDI-1.8.1/inc/server/decoder/de_configurator.hpp:30,
from /home/bakerj/REMEDI-1.8.1/inc/server/trans_task.hpp:41,
from /home/bakerj/REMEDI-1.8.1/inc/server/trans_job.hpp:32,
from /home/bakerj/REMEDI-1.8.1/inc/server/translation_manager.hpp:31,
from /home/bakerj/REMEDI-1.8.1/inc/server/translation_server.hpp:32,
from /home/bakerj/REMEDI-1.8.1/src/server/bpbd_server.cpp:46:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp: At global scope:
/home/bakerj/REMEDI-1.8.1/inc/server/lm/models/w2ch_um_storage.hpp:78:82: warning: dynamic exception specifications are deprecated in C++11 [-Wdeprecated]
inline const TShortId & at(const TShortId ctx_idx) const throw (out_of_range) {
^~~~~
CMakeFiles/bpbd-server.dir/build.make:758: recipe for target 'CMakeFiles/bpbd-server.dir/src/server/bpbd_server.cpp.o' failed
make[2]: *** [CMakeFiles/bpbd-server.dir/src/server/bpbd_server.cpp.o] Error 1
CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/bpbd-server.dir/all' failed
make[1]: *** [CMakeFiles/bpbd-server.dir/all] Error 2
Makefile:83: recipe for target 'all' failed
make: *** [all] Error 2
I have installed libssl-dev, and I'm using Ubuntu 18.04
CMakeFiles/bpbd-processor.dir/src/processor/bpbd_processor.cpp.o: In function uva::smt::bpbd::processor::processor_manager::notify_job_done(uva::smt::bpbd::processor::processor_job*)': bpbd_processor.cpp:(.text._ZN3uva3smt4bpbd9processor17processor_manager15notify_job_doneEPNS2_13processor_jobE[_ZN3uva3smt4bpbd9processor17processor_manager15notify_job_doneEPNS2_13processor_jobE]+0x5f): undefined reference touva::smt::bpbd::processor::operator<<(std::ostream&, uva::smt::bpbd::processor::processor_job const&)'
CMakeFiles/bpbd-processor.dir/src/processor/bpbd_processor.cpp.o: In function uva::smt::bpbd::processor::processor_manager::schedule_new_job(uva::smt::bpbd::processor::processor_job*)': bpbd_processor.cpp:(.text._ZN3uva3smt4bpbd9processor17processor_manager16schedule_new_jobEPNS2_13processor_jobE[_ZN3uva3smt4bpbd9processor17processor_manager16schedule_new_jobEPNS2_13processor_jobE]+0x4f): undefined reference touva::smt::bpbd::processor::operator<<(std::ostream&, uva::smt::bpbd::processor::processor_job const&)'
bpbd_processor.cpp:(.text._ZN3uva3smt4bpbd9processor17processor_manager16schedule_new_jobEPNS2_13processor_jobE[_ZN3uva3smt4bpbd9processor17processor_manager16schedule_new_jobEPNS2_13processor_jobE]+0x123): undefined reference to `uva::smt::bpbd::processor::operator<<(std::ostream&, uva::smt::bpbd::processor::processor_job const&)'
The OpenMT/MT04 links require an update in the project's documentation (README.md).
I've just done a fresh build of REMEDI 1.8.2 and tried to run the tuning scripts, and this line seems to be causing the following error:
PARSE ERROR: Argument: -t
Couldn't find match for argument
Brief USAGE:
/opt/build/Distributed-Translation-Infrastructure/script/tuning/scripts/
../../../build/bpbd-client [-d
<error|warn|usage|result|info|info1
|info2|info3>] [-c <client
configuration file>] [-f] [-s <the
translation priority>] [-u <max
#sentences per request>] [-l <min
#sentences per request>] [-o
<target language>] -O <target file
name> -i <source language> -I
<source file name> [--] [--version]
[-h]
For complete USAGE and HELP type:
/opt/build/Distributed-Translation-Infrastructure/script/tuning/scripts/../../../build/bpbd-client --help
I thought I did have this working previously, so is there something that would have caused this to start happening?
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.