Giter Site home page Giter Site logo

Parquet Support about duckdb.net HOT 15 CLOSED

giorgi avatar giorgi commented on August 27, 2024
Parquet Support

from duckdb.net.

Comments (15)

Giorgi avatar Giorgi commented on August 27, 2024

Can you describe what issues do you have with reading Parquet files?

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

image_2021_11_22T09_24_44_896Z

I'm getting the attached error while reading the parquet file.

Controller File:

using DuckDB.NET.Data;
using DuckDB_Demo1.Models;
using Microsoft.AspNetCore.Mvc;
using Newtonsoft.Json;
using System.Diagnostics;
using System.Net;
using System.Runtime.InteropServices;
using System.Text;

namespace DuckDB_Demo1.Controllers
{
public class HomeController : Controller
{
private readonly ILogger _logger;

    public HomeController(ILogger<HomeController> logger)
    {
        _logger = logger;
    }

    
    public string Index()
    {
        using (var duckDBConnection = new DuckDBConnection("Data Source=:memory:"))
        {
            duckDBConnection.Open();
            var command = duckDBConnection.CreateCommand();
            command.CommandText = "Select count(*) from parquet_scan('p3new.parquet') limit 100;";
            var executeScalar = command.ExecuteScalar();
        }

        return "";
    }
}

}

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

Does the same code work when you use native duckdb library?

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

Yes with the CLI I can able to execute the same query.

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

Which version of duckdb.dll do you have in your project?

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

V2.9.1

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

Try using 0.3.1

from duckdb.net.

ravi27may avatar ravi27may commented on August 27, 2024

It works with 0.3.1 version. Thanks Giorgi

Am trying to read parquet from aws s3, but it seems not working. Could you please help if you have any samples around this that would be really helpful. Thanks

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

Glad that it works for you.

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

I'm not able to find 0.3.1 Version where do you find that DLL, Can you please share that link.

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

You can download it from https://github.com/duckdb/duckdb/releases/tag/v0.3.1

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

Is it possible for you to share a working copy with parquet here, It would be great help thanks in advance.

from duckdb.net.

Giorgi avatar Giorgi commented on August 27, 2024

Download Windows build from the link above.

from duckdb.net.

karthikmallireddy avatar karthikmallireddy commented on August 27, 2024

Getting a lot of errors while doing it, Is there a way can you please send the working project with Duck db 0.3.1 if possibly only.

from duckdb.net.

ravi27may avatar ravi27may commented on August 27, 2024

@karthikmallireddy I used the same code (in a console) which you mentioned above, what errors you are facing?

from duckdb.net.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.