bodastage/bts-ce

Boda Telecom Suite Community Edition (BTS-CE) - An open source vendor and technology agnostic telecommunication network management platform

Boda Telecom Suite Community Edition (BTS-CE)

Boda Telecom Suite Community Edition - An open source telecommunication network management platform

Features

• Generation of network topology from configuration data
• Radio network element browsing
• CM managed object browsing
• Automatic network baseline generation
• Radio Access Network (RAN) audit (relations, conflicts, parameter values vs baseline )
• Reports that support tabular and different graphical presentation of data

Requirements

• 64 bit OS (Kernel version 3.10+ for Linux and build 10.0.14393+ for Windows)
• Docker
• Memory and disk space depend on the network /data size
• Latest web browser

Deployment/Installation

• Download latest release files (bts-ce-version) from https://github.com/bodastage/bts-ce/releases/latest
• Unzip the downloaded files
• Launch the command prompt
• From the commad prompt, change to unzipped BTS-CE folder

  > cd  /path/to/bts-ce-<version>

• Run setup command and follow any instructions given

  > bts setup

• Open web broswer and paste the URL http://localhost:8888
• Login with username: [email protected] and password: password

Installing a new release

At the moment, we don't have upgrade scripts. You have to remove the previous version and install the new one. This is achieved using the following 2 commands,

• From the old version's directory, run

   bts rm

• From the new version's directory, run

   bts create

Supported Web Browsers

Desktop Browsers	Version
Safari	6.1+
Google Chrome	32+
Microsoft Edge
Firefox	27+

Built With

• Python
• PostgreSQL
• Apache Airflow
• ReactJs
• RabbitMQ

Resources

• Online Documentation

Copyright / License

Copyright 2017 - 2019 Bodastage Solutions

Licensed under the Apache License, Version 2.0 ; you may not use this work except in compliance with the License. You may obtain a copy of the License in the LICENSE file, or at:

https://www.apache.org/licenses/LICENSE-2.0

bts-ce's Issues

Import fails when parsing MML format

Below is an extract from the logs after running
airflow test cm_etlp.parse_and_import_huawei_2g import_huawei_2g_cm_data "2018-03-10 23:13:19"
`
[2018-03-11 21:19:40,061] {bash_operator.py:94} INFO -
[2018-03-11 21:19:40,061] {bash_operator.py:94} INFO -
[2018-03-11 21:19:40,062] {bash_operator.py:94} INFO - -- AITFOTHPARA
[2018-03-11 21:19:40,062] {bash_operator.py:94} INFO - -- ---------------------------
[2018-03-11 21:19:40,062] {bash_operator.py:94} INFO - TRUNCATE TABLE hua_cm_2g.AITFOTHPARA;
[2018-03-11 21:19:40,197] {bash_operator.py:94} INFO - TRUNCATE TABLE
[2018-03-11 21:19:40,197] {bash_operator.py:94} INFO - \COPY hua_cm_2g.AITFOTHPARA FROM '/mediation/data/cm/huawei/2g/parsed/in/AITFOTHPARA.csv' CSV HEADER;
[2018-03-11 21:19:40,214] {bash_operator.py:94} INFO - psql:/mediation/conf/cm/hua_cm_2g_nbi_loader.cfg:8: ERROR: extra data after last expected column
[2018-03-11 21:19:40,214] {bash_operator.py:94} INFO - CONTEXT: COPY aitfothpara, line 2: "BSCBARG_20171017_RF.txt,2017-10-17 06:03:04,0,V900R019ENGC10SPC528,10.26.73.203,GO,,,,,,,,2,YES,NO,0..."

Cause:
The huawei MML parser is using the same parser config file as the ift-N XML parser. The result is the csv files have extra columns. The columns below that are produced by the Ift-N XML parser are not present in the MML files.

• ne_xsitype
• netype
• neversion
• neid
• module_type
• module_remark
• module_productversion

Unfortunately, the hua_cm_2g schema tables expect these column to be present in the imported csv.

Solution:

1. Provide a seperate configuration file for the MML parser
2. To maintain the column order configure the MML parser config file (hua_cm_2g_mml_parser.cfg) so that it has the same number of column as expected.

FileName --> FileName
varDateTime --> varDateTime
BSCID --> ne_xsitype
BAM_VERSION --> netype
OMU_IP --> neversion
MBSC MODE --> neid
module_type --> leave as is
module_remark --> leave as is
module_productversion --> leave as is

bts-ce-v2.0.0.rc4-process_eri_rncs

[2019-02-15 09:04:51,311] {{models.py:1736}} ERROR - (psycopg2.ProgrammingError) column "varDateTime" does not exist
LINE 6: "varDateTime" as date_added,
^
[SQL: '\n INSERT INTO live_network.nodes\n (pk,date_added, date_modified, type,"name", vendor_pk, tech_pk, added_by, modified_by)\n SELECT \n NEXTVAL('live_network.seq_nodes_pk'),\n "varDateTime" as date_added, \n "varDateTime" as date_modified, \n 'RNC' as node_type,\n "MeContext_id" as "name" , \n 1 as vendor_pk, -- 1=Ericsson, 2=Huawei\n 2 as tech_pk , -- 1=gsm, 2-umts,3=lte\n 0 as added_by,\n 0 as modified_by\n FROM ericsson_bulkcm."RncFunction" t1\n LEFT OUTER JOIN live_network.nodes t2 ON t1."MeContext_id" = t2."name"\n WHERE \n t2."name" IS NULL\n ']
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context
context)
File "/usr/local/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 470, in do_execute
cursor.execute(statement, parameters)
psycopg2.ProgrammingError: column "varDateTime" does not exist
LINE 6: "varDateTime" as date_added,
^

The above exception was the direct cause of the following exception:

Give cm_etlp DAG descriptive names

Give cm_etlp DAG descriptive names

Instructions on README file are not correct

Instructions on README file are not correct.

bts setup will not run on Mac OS X.
Instructions should be clear for all different OS.

error when installing

I have Dockers desktop installed as the toolbox is outdated.

Checking if Docker Toolbox is installed...Not Installed

Downloading Docker Toolbox...Exception calling "DownloadFile" with "2" argument(s): "The remote server returned an error: (403) Forbidden."
At C:\Users\bingoman\bts-ce-v2.1.0\win\Setup.ps1:297 char:3

•     (New-Object System.Net.WebClient).DownloadFile($DockerToolbox ...
  

•     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  

  • CategoryInfo : NotSpecified: (:) [], MethodInvocationException
  • FullyQualifiedErrorId : WebException

Failed

Check your network connectivity. Or download and install Docker Toolbox from https://download.docker.com/win/stable/DockerToolbox.exe

Add check for port availability during setup stage

Sometimes pulling images fails

ERROR: Get https://registry.gitlab.com/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Download Report crashes browser

Download Report crashes browser

Failed to load resource: net::ERR_INSUFFICIENT_RESOURCES

create_bts_database.sh

/r/n to be replaced with /n

Parser output empty file

Hi all,
Thank you a bunch for the parser.
I have a problem in the parser application.
I have created the three folders as you have mentioned and added some CM xml files in the input data folder. However, after running the code in the cmd, the output is a CSV file named "fileFooter" which doesn't have any data in it.
The command that I am running is:
java -jar C:\HUNTER\Boda\Huawei_4G_XML\Scripts\boda-huaweicfgsynparser.jar C:\HUNTER\Boda\Huawei_4G_XML\Data\MyFolderWithMyRawData C:\HUNTER\Boda\Huawei_4G_XML\Output\MyOutputFolder

Pagination of 100 not happenin

Report page not getting truncated after 100 lines

Containers always restarting

bts-ce-reports & bts-ce-mediation containers are always restarting and i get the below error while i try to login

Download Button not operational in Network Audit

Download Button not operational in Network Audit

Add .exe to .gitignore file

Add .exe to .gitignore file

For DockerToolbox installations, use port forwarding

Porting forwarding port 8888 will enable access on Windows from http://localhost:8888 instead of having to use http://192.168.99.100:8888

Add port 8888 to the web URL in the README.md

The URL used to access the web frontend is http://192.168.99.100:8888 or http://localhost:8888

Create tests for cm_etlp DAG

Create tests for configuration management processes

ImportError: cannot import name mod_netmgt

�[36mbts-ce-api |�[0m Traceback (most recent call last):
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/arbiter.py", line 515, in spawn_worker
�[36mbts-ce-api |�[0m worker.init_process()
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/workers/base.py", line 122, in init_process
�[36mbts-ce-api |�[0m self.load_wsgi()
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/workers/base.py", line 130, in load_wsgi
�[36mbts-ce-api |�[0m self.wsgi = self.app.wsgi()
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/app/base.py", line 67, in wsgi
�[36mbts-ce-api |�[0m self.callable = self.load()
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 65, in load
�[36mbts-ce-api |�[0m return self.load_wsgiapp()
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 52, in load_wsgiapp
�[36mbts-ce-api |�[0m return util.import_app(self.app_uri)
�[36mbts-ce-api |�[0m File "/usr/lib/python2.7/dist-packages/gunicorn/util.py", line 366, in import_app
�[36mbts-ce-api |�[0m import(module)
�[36mbts-ce-api |�[0m File "/app/wsgi.py", line 1, in
�[36mbts-ce-api |�[0m from btsapi import app
�[36mbts-ce-api |�[0m File "/app/btsapi/init.py", line 120, in
�[36mbts-ce-api |�[0m from btsapi.modules.networkmanagement.controllers import mod_netmgt as mod_netmgt
�[36mbts-ce-api |�[0m ImportError: cannot import name mod_netmgt

Wrong timezone

Add a way to set the correct timezone in the containers

Documentation URL on README file is not working.

http://docs.bodastage.com/

This site can’t be reacheddocs.bodastage.com’s server IP address could not be found.
Search Google for docs bodastage
ERR_NAME_NOT_RESOLVED

For Windows, installations outside c:\Users fail

Mounted volumes need to be shared. C:\Users is already mounted. Anything outside that needs to be first mounted.

For Docker for Windows, go Settings > Share drive, and select the drive

For Docker ToolBook, share the folders in virtualbox and docker-machine . See some references:

• see https://github.com/vweevers/node-docker-share
• http://support.divio.com/local-development/docker/how-to-use-a-directory-outside-cusers-with-docker-toolboxdocker-for-windows