314e/beam-pyodbc-connector

An io connector of Apache Beam to access any odbc complaint database.

Beam - pyodbc Connector

Beam - pyodbc Connector is an io connector of Apache Beam to access databases which are ODBC complaint.

Installation

pip install beam-pyodbc-connector

Getting Started

• Read From Database

from beam-pyodbc.connector import splitters
from beam-pyodbc.connector.io import ReadFromDB


read_from_db = ReadFromDB(
        query="SELECT * FROM test_db.tests;",
        host="localhost",
        database="test_db",
        user="test",
        password="test",
        port=3306,
        splitter=splitters.NoSplitter()  # you can select how to split query from splitters
)

• Write To Database

from beam-pyodbc.connector.io import WriteToDB


write_to_db = WriteToDB(
        host="localhost",
        database="test_db",
        table="tests",
        user="test",
        password="test",
        port=3306,
        batch_size=1000,
)

License

MIT License. Please refer to the LICENSE, for further details.

beam-pyodbc-connector's Issues

Is this completed?

I am trying to see source code for this but I can not see a single file. Where is the source code?

What is the pypi dependency for this package?

I tried to find the Pypi dependency using name beam-pyodc-connector , but didn't find it. Is it using some other name on Pypi? Please suggest