Giter Site home page Giter Site logo

breve's People

Contributors

cncoleman avatar esjewett avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

breve's Issues

special char pills

(Food permit sample data set)
"FoodItems" dimension: After review and assigning delimiter, they stay "hot"
"Schedule" dimension has some gray, some not when opened. Why?

Beginning of Breve design doc added

You'll see "search" in the new design doc for Breve. I hope the distinctions are clear, too.

One think we'll want to fix soon for Breve-view (actually for AHR's version) is the label "Map gaps and errors". That should be only map gaps.

Support import/export of Data Packages

Breve allows for the assignment of data type per column and immediate validation against those types. This is excellent! However, once the dataset has been cleaned, the only output seems to be the cleaned CSV. I believe this tool would be even more useful if the type information created through Breve were recorded using JSON Table Schema and the data exported as a Tabular Data Package. Likewise, on import, the type information could be automatically set using validation rules expressed via the Data Package format.

screen shot 2016-07-27 at 15 30 24

A Data Package provides a minimal "container" for transporting any kind of data. It is designed for extension to allow publishers to add additional constraints on the format and type of data and metadata.

Concretely, you can create a Data Package by placing a specially formatted file, datapackage.json, in the directory containing the files that comprise your dataset. Given a dataset called dataset.csv that looks like this:

a,b,c
1,2,3
4,5,6

A very simple example of a datapackage.json that would accompany the unaltered CSV would look like this:

{
  "name": "my-first-dataset",
  "title": "My First Dataset",
  "resources": [
    {
      "path": "dataset.csv",
      "format": "csv",
      "schema": {
        "fields": [
          {
            "name": "a",
            "type": "integer"
          },
          {
            "name": "b",
            "type": "integer"
          },
          {
            "name": "c",
            "type": "integer"
          }
        ]
      }
    }
  ]
}

The data types you support would all be expressible via the JSON Table Schema language using a combination of type, format, and constraints per field:

http://specs.frictionlessdata.io/json-table-schema/#field-descriptors

screen shot 2016-07-27 at 15 38 55

We're building an ecosystem of tools and integrations that allow the reading of Data Packages in tools already in use today: http://frictionlessdata.io/about/ . We can definitely assist in supporting this integration.

Add metrics download

Quick numbers on total number of records + number of missing values for each field + unique values for each field.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.