Giter Site home page Giter Site logo

turbot / steampipe-plugin-cloudflare Goto Github PK

View Code? Open in Web Editor NEW
9.0 10.0 5.0 657 KB

Use SQL to instantly query accounts, zones and more from Cloudflare. Open source CLI. No DB required.

Home Page: https://hub.steampipe.io/plugins/turbot/cloudflare

License: Apache License 2.0

Makefile 0.13% Go 99.21% PLSQL 0.66%
steampipe steampipe-plugin sql postgresql postgresql-fdw cloudflare hacktoberfest backup etl sqlite

steampipe-plugin-cloudflare's Introduction

image

Cloudflare Plugin for Steampipe

Use SQL to query accounts, zones and more from Cloudflare.

Quick start

Install the plugin with Steampipe:

steampipe plugin install cloudflare

Run a query:

select
  name,
  dnssec ->> 'status',
  settings ->> 'tls_1_3'
from
  cloudflare_zone

Engines

This plugin is available for the following engines:

Engine Description
Steampipe The Steampipe CLI exposes APIs and services as a high-performance relational database, giving you the ability to write SQL-based queries to explore dynamic data. Mods extend Steampipe's capabilities with dashboards, reports, and controls built with simple HCL. The Steampipe CLI is a turnkey solution that includes its own Postgres database, plugin management, and mod support.
Postgres FDW Steampipe Postgres FDWs are native Postgres Foreign Data Wrappers that translate APIs to foreign tables. Unlike Steampipe CLI, which ships with its own Postgres server instance, the Steampipe Postgres FDWs can be installed in any supported Postgres database version.
SQLite Extension Steampipe SQLite Extensions provide SQLite virtual tables that translate your queries into API calls, transparently fetching information from your API or service as you request it.
Export Steampipe Plugin Exporters provide a flexible mechanism for exporting information from cloud services and APIs. Each exporter is a stand-alone binary that allows you to extract data using Steampipe plugins without a database.
Turbot Pipes Turbot Pipes is the only intelligence, automation & security platform built specifically for DevOps. Pipes provide hosted Steampipe database instances, shared dashboards, snapshots, and more.

Developing

Prerequisites:

Clone:

git clone https://github.com/turbot/steampipe-plugin-cloudflare.git
cd steampipe-plugin-cloudflare

Build, which automatically installs the new version to your ~/.steampipe/plugins directory:

make

Configure the plugin:

cp config/* ~/.steampipe/config
vi ~/.steampipe/config/cloudflare.spc

Try it!

steampipe query
> .inspect cloudflare

Further reading:

Open Source & Contributing

This repository is published under the Apache 2.0 (source code) and CC BY-NC-ND (docs) licenses. Please see our code of conduct. We look forward to collaborating with you!

Steampipe is a product produced from this open source software, exclusively by Turbot HQ, Inc. It is distributed under our commercial terms. Others are allowed to make their own distribution of the software, but cannot use any of the Turbot trademarks, cloud services, etc. You can learn more in our Open Source FAQ.

Get Involved

Join #steampipe on Slack →

Want to help but don't know where to start? Pick up one of the help wanted issues:

steampipe-plugin-cloudflare's People

Contributors

avicoder avatar bigdatasourav avatar cbruno10 avatar dependabot[bot] avatar e-gineer avatar lalitlab avatar madhushreeray30 avatar misraved avatar rahulsrivastav14 avatar subhajit97 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

steampipe-plugin-cloudflare's Issues

Add dnssec and settings column to the cloudflare_zone table

Describe the bug
dnssec and settings column have been commented out from cloudflare_zone table. This is resulting in the failure of example queries provided in the documentation

Steampipe version (steampipe -v)
Example: v0.8.4

Plugin version (steampipe plugin list)
Example: v0.0.2

To reproduce

  1. Run
select
  name,
  dnssec ->> 'status',
  settings ->> 'tls_1_3'
from
  cloudflare_zone

Expected behaviour
A clear and concise description of what you expected to happen.

Additional context
Error -

Error: column "dnssec" does not exist
Error: column "settings" does not exist

Strange behaviour with cloudflare_account_member table

Describe the bug

> steampipe query
Welcome to Steampipe v0.14.6
For more information, type .help
> select * from cloudflare_account_member
⠴ Loading results: 142

The results load in ~4 seconds, but then it hangs.. Until I press Ctrl+C and the table of results is displayed.

When I immediately run the query a second time, it's very slow ~90 seconds to load the results. Same issue as before with the Ctrl+C required to display the table.

(I can quickly quit and restart steampipe to run two sequential ~4 second queries, so rate limiting is not an issue here.)

Steampipe version (steampipe -v)
steampipe version 0.14.6

Plugin version (steampipe plugin list)

+---------------------------------------------------+---------+-----------------+
| Name                                              | Version | Connections     |
+---------------------------------------------------+---------+-----------------+
| hub.steampipe.io/plugins/turbot/cloudflare@latest | 0.4.0   | cloudflare      |
| hub.steampipe.io/plugins/turbot/kubernetes@latest | 0.8.0   | eu,gl,us,all,au |
| hub.steampipe.io/plugins/turbot/pagerduty@latest  | 0.1.0   | pagerduty       |
+---------------------------------------------------+---------+-----------------+

To reproduce

> select * from cloudflare_account_member

Expected behavior
Query returns results quickly, with no Ctrl+C required.

v0.0.1

v0.0.1 [2021-03-11]

What's new?

  • Initial release with tables for accounts, API tokens, DNS records, users, and zones.

Steampipe hangs on cloudflare_account_member query

Describe the bug
When performing a query on the cloudflare_account_member table, Steampipe hangs.
No results are available and the process does not time out.

Steampipe version (steampipe -v)
steampipe version 0.16.1

Plugin version (steampipe plugin list)
hub.steampipe.io/plugins/turbot/cloudflare@latest | 0.4.0 | cloudflare

To reproduce
QUERY="select title, user_email from cloudflare_account_member where account_id='$ACCOUNTID';"
steampipe query "$QUERY" --output json

Expected behavior
The results from the query should be returned and the process terminates.
Alternatively, Steampipe should terminate and return an error.

Additional context
Steampipe is running within a debian:bullseye-slim based container.

This is probably related to #33.

Edit: if forgot the trace logs:

Installed plugin: �[1mcloudflare@latest�[0m v0.4.0
Documentation:    https://hub.steampipe.io/plugins/turbot/cloudflare

Generated config file. Retrieving user list from Cloudflare.
2022-09-19 06:55:26.370 UTC [TRACE] steampipe: No memory limit set
2022-09-19 06:55:26.373 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/plugins/turbot/cloudflare:latest
2022-09-19 06:55:26.373 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/plugins/turbot/cloudflare:latest
2022-09-19 06:55:27.091 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.linux-amd64.layer.v1+gzip
2022-09-19 06:55:27.091 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.docs.layer.v1+tar
2022-09-19 06:55:27.091 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.spc.layer.v1+tar
2022-09-19 06:55:27.091 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.plugin.license.layer.v1+text
2022-09-19 06:55:28.602 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-09-19 06:55:28.607 UTC [TRACE] steampipe: calling removeRunningInstanceInfo
2022-09-19 06:55:28.613 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/steampipe/db:14.2.0
2022-09-19 06:55:28.613 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/steampipe/db:14.2.0
2022-09-19 06:55:45.896 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.linux-amd64.layer.v1+tar
2022-09-19 06:55:45.897 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.doc.layer.v1+text
2022-09-19 06:55:45.902 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.db.license.layer.v1+text
2022-09-19 06:55:46.591 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-09-19 06:55:46.668 UTC [TRACE] steampipe: ociDownloader.Download: downloading us-docker.pkg.dev/steampipe/steampipe/fdw:1.3.2
2022-09-19 06:55:46.668 UTC [TRACE] steampipe: ociDownloader.Pull: pulling us-docker.pkg.dev/steampipe/steampipe/fdw:1.3.2
2022-09-19 06:55:48.765 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.linux-amd64.layer.v1+gzip
2022-09-19 06:55:48.765 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.control.layer.v1+text
2022-09-19 06:55:48.765 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.sql.layer.v1+text
2022-09-19 06:55:48.765 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.doc.layer.v1+text
2022-09-19 06:55:48.765 UTC [TRACE] steampipe: looking for application/vnd.turbot.steampipe.fdw.license.layer.v1+text
2022-09-19 06:55:59.103 UTC [TRACE] steampipe: initdb start: /home/scanner/.steampipe/db/14.2.0/postgres/bin/initdb --auth=trust --username=root --pgdata=/home/scanner/.steampipe/db/14.2.0/data --encoding=UTF-8 --wal-segsize=1 --debug
2022-09-19 06:56:43.643 UTC [TRACE] steampipe: Connection string:  host=localhost port=35231 user=root dbname=postgres sslmode=disable
2022-09-19 06:56:43.822 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.822 UTC [43] LOG:  starting PostgreSQL 14.2 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 4.8.4-2ubuntu1~14.04.4) 4.8.4, 64-bit
2022-09-19 06:56:43.857 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.854 UTC [43] LOG:  listening on IPv4 address "127.0.0.1", port 35231
2022-09-19 06:56:43.860 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.860 UTC [43] LOG:  could not bind IPv6 address "::1": Cannot assign requested address
2022-09-19 06:56:43.880 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.880 UTC [43] LOG:  listening on Unix socket "/tmp/.s.PGSQL.35231"
2022-09-19 06:56:43.894 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.893 UTC [43] LOG:  hostssl record cannot match because SSL is disabled
2022-09-19 06:56:43.894 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.893 UTC [43] HINT:  Set ssl = on in postgresql.conf.
2022-09-19 06:56:43.894 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.893 UTC [43] CONTEXT:  line 2 of configuration file "/home/scanner/.steampipe/db/14.2.0/data/pg_hba.conf"
2022-09-19 06:56:43.956 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.907 UTC [45] FATAL:  the database system is starting up
2022-09-19 06:56:43.956 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.933 UTC [44] LOG:  database system was shut down at 2022-09-19 06:56:40 UTC
2022-09-19 06:56:43.958 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:43.957 UTC [43] LOG:  database system is ready to accept connections
2022-09-19 06:56:44.093 UTC [TRACE] steampipe: valid database name: steampipe
2022-09-19 06:56:44.093 UTC [TRACE] steampipe: installing database with name steampipe
2022-09-19 06:56:45.810 UTC [TRACE] steampipe: Install Foreign Server:  drop extension if exists "steampipe_postgres_fdw" cascade
2022-09-19 06:56:45.810 UTC [TRACE] steampipe: Install Foreign Server:  create extension if not exists "steampipe_postgres_fdw"
2022-09-19 06:56:46.038 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.038 UTC [INFO]  hub: .
2022-09-19 06:56:46.038 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-09-19 06:56:46.038 UTC [TRACE] steampipe: SERVICE: 		steampipe postgres fdw init
2022-09-19 06:56:46.038 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-09-19 06:56:46.038 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.038 UTC [INFO]  hub: Version:   v1.3.2
2022-09-19 06:56:46.039 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.038 UTC [INFO]  hub: Log level: trace
2022-09-19 06:56:46.041 UTC [TRACE] steampipe: Install Foreign Server:  create server "steampipe" foreign data wrapper "steampipe_postgres_fdw"
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.043 UTC [INFO]  hub: .
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: 		steampipe postgres fdw shutdown
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: ******************************************************
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.043 UTC [TRACE] hub: init telemetry
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.043 UTC [TRACE] hub: telemetry.Init service 'steampipe-postgres-fdw', tracingEnabled: false, metricsEnabled: false
2022-09-19 06:56:46.044 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.043 UTC [TRACE] hub: metrics and tracing disabled' - returning
2022-09-19 06:56:46.045 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.044 UTC [43] LOG:  received smart shutdown request
2022-09-19 06:56:46.045 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.044 UTC [TRACE] hub: hub: close
2022-09-19 06:56:46.045 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.044 UTC [TRACE] hub: shutdown telemetry
2022-09-19 06:56:46.113 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.109 UTC [43] LOG:  background worker "logical replication launcher" (PID 51) exited with exit code 1
2022-09-19 06:56:46.113 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.112 UTC [46] LOG:  shutting down
2022-09-19 06:56:46.310 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:46.310 UTC [43] LOG:  database system is shut down
2022-09-19 06:56:46.345 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-09-19 06:56:46.345 UTC [TRACE] steampipe: StartDB invoker plugin
2022-09-19 06:56:46.346 UTC [TRACE] steampipe: StartDB started plugin manager
2022-09-19 06:56:46.346 UTC [TRACE] steampipe: loadRootPrivateKey - failed to load key from /home/scanner/.steampipe/db/14.2.0/data/root.key: open /home/scanner/.steampipe/db/14.2.0/data/root.key: no such file or directory
2022-09-19 06:56:49.653 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=disable
2022-09-19 06:56:50.391 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:50.389 UTC [58] LOG:  redirecting log output to logging collector process
2022-09-19 06:56:50.392 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:50.389 UTC [58] HINT:  Future log output will appear in directory "/home/scanner/.steampipe/logs".
2022-09-19 06:56:50.596 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:50.596 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=require
2022-09-19 06:56:50.788 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:50.788 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:50.957 UTC [TRACE] steampipe: Install Foreign Server:  drop extension if exists "steampipe_postgres_fdw" cascade
2022-09-19 06:56:50.969 UTC [TRACE] steampipe: Install Foreign Server:  create extension if not exists "steampipe_postgres_fdw"
2022-09-19 06:56:51.991 UTC [TRACE] steampipe: Install Foreign Server:  create server "steampipe" foreign data wrapper "steampipe_postgres_fdw"
2022-09-19 06:56:52.532 UTC [TRACE] steampipe: plugin manager state file not found
2022-09-19 06:56:52.532 UTC [TRACE] steampipe: plugin manager state file not found
2022-09-19 06:56:52.990 UTC [TRACE] steampipe: start: started plugin manager, pid 76
2022-09-19 06:56:53.240 UTC [TRACE] steampipe: created local client 0xc000a53e60
2022-09-19 06:56:53.240 UTC [TRACE] steampipe: getSchemaHashesForDynamicSchemas
2022-09-19 06:56:53.259 UTC [TRACE] steampipe: fetched schema for 0 dynamic plugins
2022-09-19 06:56:53.259 UTC [TRACE] steampipe: connection cloudflare is out of date or missing
2022-09-19 06:56:53.259 UTC [TRACE] steampipe: CreateConnectionPlugin creating 1 connections
2022-09-19 06:56:53.260 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-09-19 06:56:54.073 UTC [TRACE] steampipe: createConnectionPlugin for connection cloudflare
2022-09-19 06:56:54.073 UTC [TRACE] steampipe: plugin manager returned reattach config for connection 'cloudflare' - pid 89
2022-09-19 06:56:54.073 UTC [TRACE] steampipe: NewPluginClientFromReattach for plugin hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:54.073 UTC [TRACE] steampipe: NewPluginClient for plugin hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: plugin client created for hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: multiple connections NOT supported - adding single connection 'cloudflare' to ConnectionPlugin
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: created connection plugin for connection: 'cloudflare', pluginName: 'hub.steampipe.io/plugins/turbot/cloudflare@latest'
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: all connection plugins created, populating schemas
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: populateConnectionPluginSchemas
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: populateConnectionPluginSchemas: connectionName: cloudflare
2022-09-19 06:56:54.092 UTC [TRACE] steampipe: schema does not exist in list of static schemas, fetching
2022-09-19 06:56:54.108 UTC [TRACE] steampipe: got schema, mode: static
2022-09-19 06:56:54.117 UTC [TRACE] steampipe: add schema to connection map for connection name cloudflare
2022-09-19 06:56:54.118 UTC [TRACE] steampipe: populate schemas complete
2022-09-19 06:56:54.124 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:54.126 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:54.294 UTC [TRACE] steampipe: executeConnectionUpdateQueries: num updates 1
2022-09-19 06:56:54.302 UTC [TRACE] steampipe: executing 1 update query
2022-09-19 06:56:55.254 UTC [TRACE] steampipe: all update queries executed
2022-09-19 06:56:55.255 UTC [TRACE] steampipe: executing 1 comment query
2022-09-19 06:56:55.449 UTC [TRACE] steampipe: executeUpdateQueries complete
2022-09-19 06:56:55.450 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:55.450 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:55.764 UTC [TRACE] steampipe: setting user search path to [public cloudflare internal]
2022-09-19 06:56:55.789 UTC [TRACE] steampipe: user search path sql: alter user "steampipe" set search_path to "public","cloudflare","internal";
2022-09-19 06:56:55.789 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:55.789 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:56.022 UTC [TRACE] steampipe: close local client 0xc000a53e60
2022-09-19 06:56:56.022 UTC [TRACE] steampipe: local client not NIL
2022-09-19 06:56:56.022 UTC [TRACE] steampipe: DbClient.Close &{0 0xc000a1b770 0 {0 0} [0xc000667dd0] map[] 0 1 0xc000a62120 false map[0xc000667dd0:map[0xc000667dd0:true]] map[] 0 5 600000000000 60000000000 0xc000a625a0 0 0 0 0 0x49ac20}
2022-09-19 06:56:56.022 UTC [TRACE] steampipe: local client close complete
2022-09-19 06:56:56.022 UTC [TRACE] steampipe: shutdown local service plugin
2022-09-19 06:56:56.029 UTC [TRACE] steampipe: status:  {"pid":58,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"plugin","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:56.029 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:56.260 UTC [TRACE] steampipe: StopDB invoker plugin, force false
2022-09-19 06:56:56.260 UTC [TRACE] steampipe: plugin manager stop
2022-09-19 06:56:56.273 UTC [TRACE] steampipe: pluginManager.Shutdown
2022-09-19 06:56:56.273 UTC [TRACE] steampipe: PluginManagerClient Shutdown
2022-09-19 06:56:56.330 UTC [TRACE] steampipe: pluginManager state.kill
2022-09-19 06:56:57.198 UTC [TRACE] steampipe: No memory limit set
2022-09-19 06:56:57.198 UTC [TRACE] steampipe: no modfile exists in workspace folder - NOT creating pseudoresources and only loading resource files from top level folder
2022-09-19 06:56:57.209 UTC [TRACE] steampipe: parse complete after 1 decode passes
2022-09-19 06:56:57.213 UTC [TRACE] steampipe: parse complete after 1 decode passes
2022-09-19 06:56:57.214 UTC [TRACE] steampipe: telemetry.Init service 'steampipe', tracingEnabled: false, metricsEnabled: false
2022-09-19 06:56:57.214 UTC [TRACE] steampipe: metrics and tracing disabled' - returning
2022-09-19 06:56:57.214 UTC [TRACE] steampipe: GetRunStatus - loadRunningInstanceInfo returned nil
2022-09-19 06:56:57.214 UTC [TRACE] steampipe: StartDB invoker query
2022-09-19 06:56:57.214 UTC [TRACE] steampipe: StartDB started plugin manager
2022-09-19 06:56:57.224 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=disable
2022-09-19 06:56:57.690 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:57.690 UTC [119] LOG:  redirecting log output to logging collector process
2022-09-19 06:56:57.691 UTC [TRACE] steampipe: SERVICE: 2022-09-19 06:56:57.690 UTC [119] HINT:  Future log output will appear in directory "/home/scanner/.steampipe/logs".
2022-09-19 06:56:57.803 UTC [TRACE] steampipe: status:  {"pid":119,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"query","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:57.803 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=postgres sslmode=require
2022-09-19 06:56:57.895 UTC [TRACE] steampipe: status:  {"pid":119,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"query","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:57.895 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:58.155 UTC [TRACE] steampipe: plugin manager state file not found
2022-09-19 06:56:58.155 UTC [TRACE] steampipe: plugin manager state file not found
2022-09-19 06:56:58.378 UTC [TRACE] steampipe: start: started plugin manager, pid 141
2022-09-19 06:56:58.511 UTC [TRACE] steampipe: created local client 0xc00049b480
2022-09-19 06:56:58.512 UTC [TRACE] steampipe: resolveQuery select title, user_email from cloudflare_account_member where account_id='32a4668d7d4342354c9c6120e470589c'; args <empty>
2022-09-19 06:56:58.512 UTC [TRACE] steampipe: getSchemaHashesForDynamicSchemas
2022-09-19 06:56:58.516 UTC [TRACE] steampipe: fetched schema for 0 dynamic plugins
2022-09-19 06:56:58.516 UTC [TRACE] steampipe: connection cloudflare is out of date or missing
2022-09-19 06:56:58.516 UTC [TRACE] steampipe: CreateConnectionPlugin creating 1 connections
2022-09-19 06:56:58.517 UTC [TRACE] steampipe: plugin manager is running - returning client
2022-09-19 06:56:58.856 UTC [TRACE] steampipe: createConnectionPlugin for connection cloudflare
2022-09-19 06:56:58.856 UTC [TRACE] steampipe: plugin manager returned reattach config for connection 'cloudflare' - pid 154
2022-09-19 06:56:58.856 UTC [TRACE] steampipe: NewPluginClientFromReattach for plugin hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:58.856 UTC [TRACE] steampipe: NewPluginClient for plugin hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: plugin client created for hub.steampipe.io/plugins/turbot/cloudflare@latest
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: multiple connections NOT supported - adding single connection 'cloudflare' to ConnectionPlugin
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: created connection plugin for connection: 'cloudflare', pluginName: 'hub.steampipe.io/plugins/turbot/cloudflare@latest'
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: all connection plugins created, populating schemas
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: populateConnectionPluginSchemas
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: populateConnectionPluginSchemas: connectionName: cloudflare
2022-09-19 06:56:58.859 UTC [TRACE] steampipe: schema does not exist in list of static schemas, fetching
2022-09-19 06:56:58.896 UTC [TRACE] steampipe: got schema, mode: static
2022-09-19 06:56:58.896 UTC [TRACE] steampipe: add schema to connection map for connection name cloudflare
2022-09-19 06:56:58.896 UTC [TRACE] steampipe: populate schemas complete
2022-09-19 06:56:58.944 UTC [TRACE] steampipe: status:  {"pid":119,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"query","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:58.944 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:59.074 UTC [TRACE] steampipe: executeConnectionUpdateQueries: num updates 1
2022-09-19 06:56:59.075 UTC [TRACE] steampipe: executing 1 update query
2022-09-19 06:56:59.689 UTC [TRACE] steampipe: all update queries executed
2022-09-19 06:56:59.712 UTC [TRACE] steampipe: executing 1 comment query
2022-09-19 06:56:59.760 UTC [TRACE] steampipe: executeUpdateQueries complete
2022-09-19 06:56:59.775 UTC [TRACE] steampipe: status:  {"pid":119,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"query","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:59.775 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:56:59.946 UTC [TRACE] steampipe: setting user search path to [public cloudflare internal]
2022-09-19 06:56:59.957 UTC [TRACE] steampipe: user search path sql: alter user "steampipe" set search_path to "public","cloudflare","internal";
2022-09-19 06:56:59.964 UTC [TRACE] steampipe: status:  {"pid":119,"port":9193,"listen":["localhost","127.0.0.1"],"listen_type":"local","invoker":"query","password":"XXXX-XXXX-XXXX","user":"steampipe","database":"steampipe","struct_version":20220411}
2022-09-19 06:56:59.964 UTC [TRACE] steampipe: Connection string:  host=localhost port=9193 user=root dbname=steampipe sslmode=require
2022-09-19 06:57:00.083 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-09-19 06:57:00.083 UTC [TRACE] steampipe: updated the required search path to "public","cloudflare","internal"
2022-09-19 06:57:00.083 UTC [TRACE] steampipe: session search path will be updated to  "public","cloudflare","internal"
2022-09-19 06:57:00.095 UTC [TRACE] steampipe: CreatePreparedStatements
2022-09-19 06:57:00.130 UTC [TRACE] steampipe: ensureSessionSearchPath
2022-09-19 06:57:00.131 UTC [TRACE] steampipe: updated the required search path to "public","cloudflare","internal"
2022-09-19 06:57:00.131 UTC [TRACE] steampipe: session search path is already correct - nothing to do

Possibility to add Audit log?

Hi, I'm a happy steampipe user - mostly with the kubernetes plugin.

WIthout understanding the limitations on speed/data, I wonder is it feasible to add something like the Audit API from Cloudflare?

https://api.cloudflare.com/#audit-logs-properties

According to the docs, the API caps at 18 months of logs... So it's not a linearly growing set of data; it will however be a lot of rows.

https://developers.cloudflare.com/fundamentals/get-started/basic-tasks/account-security/review-audit-logs/#using-the-api

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.