Giter Site home page Giter Site logo

fivetran-chloe / dbt_instagram_business Goto Github PK

View Code? Open in Web Editor NEW

This project forked from fivetran/dbt_instagram_business

0.0 0.0 0.0 539 KB

Fivetran data models for Instagram Business built using dbt.

Home Page: https://fivetran.github.io/dbt_instagram_business/

dbt_instagram_business's Introduction

Apache License

Instagram Business

This package models Instagram Business data from Fivetran's connector. It uses data in the format described by this ERD.

The main focus of the package is to transform the core social media object tables into analytics-ready models that can be easily unioned in to other social media platform packages to get a single view. This is aided by our Social Media Reporting package.

Models

This package contains transformation models, designed to work simultaneously with our Instagram Business source package and our multi-platform Social Media Reporting package. A dependency on the source package is declared in this package's packages.yml file, so it will automatically download when you run dbt deps. The primary outputs of this package are described below.

model description
instagram_business__posts Each record represents the daily performance of a post or story.

Installation Instructions

Check dbt Hub for the latest installation instructions, or read the dbt docs for more information on installing packages.

Include in your packages.yml

packages:
  - package: fivetran/instagram_business
    version: [">=0.1.0", "<0.2.0"]

Package Maintenance

The Fivetran team maintaining this package only maintains the latest version. We recommend you keep your packages.yml updated with the dbt hub latest version. You may refer to the CHANGELOG and release notes for more information on changes across versions.

Configuration

By default, this package will look for your Instagram Business data in the instagram_business schema of your target database. If this is not where your Instagram Business data is, add the following configuration to your dbt_project.yml file:

# dbt_project.yml

...
config-version: 2

vars:
    instagram_business_schema: your_schema_name
    instagram_business_database: your_database_name 

Unioning Multiple Instagram Business Connectors

If you have multiple Instagram Business connectors in Fivetran and want to use this package on all of them simultaneously, we have provided functionality to do so. The package will union all of the data together and pass the unioned table(s) into the final models. You will be able to see which source it came from in the source_relation column(s) of each model. To use this functionality, you will need to set either (note that you cannot use both) the union_schemas or union_databases variables:

# dbt_project.yml
...
config-version: 2
vars:
    ##You may set EITHER the schemas variables below
    instagram_business_union_schemas: ['instagram_business_one','instagram_business_two']

    ##Or may set EITHER the databases variables below
    instagram_business_union_databases: ['instagram_business_one','instagram_business_two']

Changing the Build Schema

By default, this package will build the Instagram Business staging models within a schema titled (<target_schema> + _stg_instagram_business) and the final Instagram Business models within a schema titled (<target_schema> + _instagram_business) in your target database. If this is not where you want your Instagram Business staging data to be written to, add the following configuration to your dbt_project.yml file:

# dbt_project.yml

...
models:
    instagram_business:
      +schema: my_new_schema_name # leave blank for just the target_schema
    instagram_business_source:
      +schema: my_new_schema_name # leave blank for just the target_schema

Contributions

Don't see a model or specific metric you would like to be included? Notice any bugs when installing and running the package? If so, we highly encourage and welcome contributions to this package! Please create issues or open PRs against main. See the Discourse post for information on how to contribute to a package.

Database Support

This package has been tested on BigQuery, Snowflake, Redshift, Postgres, and Databricks.

Databricks Dispatch Configuration

dbt v0.20.0 introduced a new project-level dispatch configuration that enables an "override" setting for all dispatched macros. If you are using a Databricks destination with this package you will need to add the below (or a variation of the below) dispatch configuration within your dbt_project.yml. This is required in order for the package to accurately search for macros within the dbt-labs/spark_utils then the dbt-labs/dbt_utils packages respectively.

# dbt_project.yml

dispatch:
  - macro_namespace: dbt_utils
    search_order: ['spark_utils', 'dbt_utils']

Resources:

  • Provide feedback on our existing dbt packages or what you'd like to see next
  • Have questions or feedback, or need help? Book a time during our office hours here or email us at [email protected].
  • Find all of Fivetran's pre-built dbt packages in our dbt hub
  • Learn how to orchestrate dbt transformations with Fivetran here.
  • Learn more about Fivetran overall in our docs
  • Check out Fivetran's blog
  • Learn more about dbt in the dbt docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the dbt blog for the latest news on dbt's development and best practices

dbt_instagram_business's People

Contributors

fivetran-sheringuyen avatar dylanbaker avatar fivetran-joemarkiewicz avatar jlmendgom5tran avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.