Specified Key too long with opentaxii-create-services

[misp]

Specified Key too long with opentaxii-create-services

[FloatingGhost]

I know this exact error - this is due to an old version of MySQL.

I think MySQL 5.6 fixed this issue - I don't know which version of mariadb this relates to though.

Try running an update on the container and see if it works

[combobulator]

Thanks for your help, updating MariaDB to 10.1 from 10.0 fixed the issue.
For posterity my versions are now:
mysql Ver 15.1 Distrib 10.1.22-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2

For anyone else that stumbles on this page, the steps I took:
# apt-get install software-properties-common
# apt-key adv --recv-keys --keyserver hkp://keyserver.ubuntu.com:80 0xF1656F24C74CD1D8
# add-apt-repository 'deb [arch=amd64,i386,ppc64el] http://mirrors.coreix.net/mariadb/repo/10.1/ubuntu xenial main'
# apt-get update && apt-get upgrade
# apt-get install
# apt-get install mysql-common mariadb-common libmysqlclient18 libmariadbclient18 mariadb-client-core-10.1 mariadb-client-10.1 mariadb-server-core-10.1 mariadb-server-10.1 libmariadbclient-dev mariadb-server

I've now got another problem though, same command, different error :(
It occurs with the standard 'services.yaml' as well as with my edited version.
It strikes me that this may be more suited to the OpenTAXII issues page; happy to close this and move over there but first wanted to check if you'd come across it before.

# opentaxii-create-services -c services.yaml
2017-03-29T10:17:37.716675Z [opentaxii.utils] info: api.initialized {timestamp=2017-03-29T10:17:37.716675Z, event=api.initialized, api=opentaxii.persistence.sqldb.SQLDatabaseAPI, level=info, logger=opentaxii.utils}
2017-03-29T10:17:37.738597Z [opentaxii.utils] info: api.initialized {timestamp=2017-03-29T10:17:37.738597Z, event=api.initialized, api=opentaxii.auth.sqldb.SQLDatabaseAPI, level=info, logger=opentaxii.utils}
2017-03-29T10:17:37.738820Z [opentaxii.server] info: taxiiserver.configured {timestamp=2017-03-29T10:17:37.738820Z, event=taxiiserver.configured, logger=opentaxii.server, level=info}
Loading: services.yaml
Traceback (most recent call last):
File "/usr/local/bin/opentaxii-create-services", line 9, in
load_entry_point('opentaxii==0.1.8a1', 'console_scripts', 'opentaxii-create-services')()
File "/usr/local/lib/python3.5/dist-packages/opentaxii-0.1.8a1-py3.5.egg/opentaxii/cli/persistence.py", line 23, in create_services
services_config = anyconfig.load(args.config, forced_type="yaml")
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/api.py", line 377, in load
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/api.py", line 262, in single_load
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/backend/base.py", line 290, in load
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/backend/base.py", line 424, in load_from_path
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/backend/base.py", line 75, in wrapper
File "/usr/local/lib/python3.5/dist-packages/anyconfig-0.9.1-py3.5.egg/anyconfig/backend/yaml.py", line 167, in _yml_load
ValueError: dictionary update sequence element #0 has length 9; 2 is required

[FloatingGhost]

_yml_load
ValueError: dictionary update sequence element #0 has length 9; 2 is required

this sounds like you have a bad yaml file - any chance you could post your services.yaml here if you've changed it?

[combobulator]

Tried each of the attached. services.yaml is exactly as it was when I cloned the repo, my.services just has changed descriptions. Had to add .txt to upload here

my.services.yaml.txt
services.yaml.txt

[FloatingGhost]

That's very weird. I'm using the same version of opentaxii as you, and the create-services script runs just fine with your config.

However, I do appear to be using anyconfig v0.7.0.

Ah here we go. I get the same error as you now if I swap to anyconfig 0.9.1.

I'll see if they updated opentaxii to be compatible with this new version

[FloatingGhost]

Ok, there you go - pushed a commit that updates OpenTaxii and gives a slightly different config file. That should fix it for you :)

[combobulator]

Awesomesauce, thanks, I'll check it out now and report back :)

EDIT: Worked great :)
I just ran the new OpenTAXII setup script and went straight to installing the services (used the original configs), and now services & collections were created successfully.

[Danko90]

Hello,
I had the same error and I fixed it by putting the string

services:

at the top in config/services.yaml

Did it work for you even without that string?

[FloatingGhost]

Well obviously, otherwise I'd have put that in

[ventz]

Running into similar issue with mariadb-server-10.1:

sqlalchemy.exc.InternalError: (pymysql.err.InternalError) (1071, 'Specified key was too long; max key length is 767 bytes') [SQL: 'CREATE UNIQUE INDEX ix_data_collections_name ON data_collections (name)']

I don't want to create a new issue since it seems related?

Error caused simply by running default: opentaxii-sync-data config/data-configuration.yaml