Parquet.Net
1.5.1
See the version list below for details.
dotnet add package Parquet.Net --version 1.5.1
NuGet\Install-Package Parquet.Net -Version 1.5.1
<PackageReference Include="Parquet.Net" Version="1.5.1" />
paket add Parquet.Net --version 1.5.1
#r "nuget: Parquet.Net, 1.5.1"
// Install Parquet.Net as a Cake Addin
#addin nuget:?package=Parquet.Net&version=1.5.1
// Install Parquet.Net as a Cake Tool
#tool nuget:?package=Parquet.Net&version=1.5.1
A .NET library to read and write Apache Parquet files.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
| .NET Core | netcoreapp1.0 was computed. netcoreapp1.1 was computed. netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
| .NET Standard | netstandard1.4 is compatible. netstandard1.5 was computed. netstandard1.6 was computed. netstandard2.0 was computed. netstandard2.1 was computed. |
| .NET Framework | net451 is compatible. net452 was computed. net46 was computed. net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
| MonoAndroid | monoandroid was computed. |
| MonoMac | monomac was computed. |
| MonoTouch | monotouch was computed. |
| Tizen | tizen30 was computed. tizen40 was computed. tizen60 was computed. |
| Universal Windows Platform | uap was computed. uap10.0 was computed. |
| Xamarin.iOS | xamarinios was computed. |
| Xamarin.Mac | xamarinmac was computed. |
| Xamarin.TVOS | xamarintvos was computed. |
| Xamarin.WatchOS | xamarinwatchos was computed. |
-
.NETFramework 4.5.1
- No dependencies.
-
.NETStandard 1.4
- NETStandard.Library (>= 1.6.1)
NuGet packages (21)
Showing the top 5 NuGet packages that depend on Parquet.Net:
| Package | Downloads |
|---|---|
ChoETL.Parquet
Parquet extension to Cinchoo ETL framework |
|
|
Microsoft.DataPrep
Microsoft Azure Machine Learning Data Preparation SDK. |
|
|
Komodo.Core
Komodo core libraries for crawling (file, object, web, database), parsing (JSON, XML, SQL, Sqlite, HTML, text), postings (inverted index, token extraction), indexing (search), metadata generation, and integrating within your application. Komodo is an information search, metadata, storage, and retrieval platform. |
|
|
DataFrame.Math
A suite of libraries to provide stats functionality in dotnet for parquet and other formats |
|
|
Microsoft.ML.Parquet
ML.NET components for Apache Parquet support. |
GitHub repositories (6)
Showing the top 5 popular GitHub repositories that depend on Parquet.Net:
| Repository | Stars |
|---|---|
|
dotnet/machinelearning
ML.NET is an open source and cross-platform machine learning framework for .NET.
|
|
|
ravendb/ravendb
ACID Document Database
|
|
|
Cinchoo/ChoETL
ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)
|
|
|
mukunku/ParquetViewer
Simple windows desktop application for viewing & querying Apache Parquet files
|
|
|
compomics/ThermoRawFileParser
Thermo RAW file parser that runs on Linux/Mac and all other platforms that support Mono
|
| Version | Downloads | Last updated |
|---|---|---|
| 4.23.5 | 5,758 | 4/4/2024 |
| 4.23.4 | 109,747 | 2/2/2024 |
| 4.23.3 | 9,564 | 1/25/2024 |
| 4.23.2 | 4,123 | 1/22/2024 |
| 4.23.1 | 4,992 | 1/19/2024 |
| 4.23.0 | 2,069 | 1/18/2024 |
| 4.22.1 | 4,066 | 1/17/2024 |
| 4.22.0 | 24,072 | 1/11/2024 |
| 4.20.1 | 2,578 | 1/10/2024 |
| 4.20.0 | 7,827 | 1/8/2024 |
| 4.19.0 | 7,859 | 1/5/2024 |
| 4.18.1 | 4,727 | 12/31/2023 |
| 4.18.0 | 9,537 | 12/22/2023 |
| 4.17.0 | 126,305 | 11/14/2023 |
| 4.16.4 | 221,402 | 9/11/2023 |
| 4.16.3 | 24,664 | 9/4/2023 |
| 4.16.2 | 59,723 | 8/22/2023 |
| 4.16.1 | 4,059 | 8/21/2023 |
| 4.16.0 | 2,524 | 8/17/2023 |
| 4.15.0 | 103,320 | 6/30/2023 |
| 4.14.0 | 17,152 | 6/28/2023 |
| 4.13.0 | 79,709 | 6/20/2023 |
| 4.12.0 | 117,965 | 5/22/2023 |
| 4.11.3 | 8,012 | 5/18/2023 |
| 4.11.2 | 34,153 | 5/16/2023 |
| 4.11.1 | 23,442 | 5/10/2023 |
| 4.11.0 | 4,267 | 5/9/2023 |
| 4.10.1 | 26,762 | 5/2/2023 |
| 4.10.0 | 25,162 | 4/26/2023 |
| 4.9.2 | 2,447 | 4/25/2023 |
| 4.9.1 | 3,272 | 4/21/2023 |
| 4.9.0 | 1,874 | 4/21/2023 |
| 4.8.1 | 8,573 | 4/19/2023 |
| 4.8.0 | 2,387 | 4/18/2023 |
| 4.8.0-alpha-00 | 1,475 | 4/17/2023 |
| 4.7.1 | 4,924 | 4/14/2023 |
| 4.7.0 | 7,237 | 4/13/2023 |
| 4.6.2 | 53,743 | 3/28/2023 |
| 4.6.1 | 4,744 | 3/23/2023 |
| 4.6.0 | 11,830 | 3/21/2023 |
| 4.5.4 | 262,632 | 2/23/2023 |
| 4.5.3 | 12,226 | 2/22/2023 |
| 4.5.2 | 9,349 | 2/20/2023 |
| 4.5.1 | 7,009 | 2/14/2023 |
| 4.5.0 | 4,587 | 2/13/2023 |
| 4.4.7 | 11,298 | 2/8/2023 |
| 4.4.6 | 43,525 | 1/31/2023 |
| 4.4.5 | 2,834 | 1/30/2023 |
| 4.4.4 | 2,243 | 1/27/2023 |
| 4.4.3 | 2,999 | 1/26/2023 |
| 4.4.2 | 1,675 | 1/26/2023 |
| 4.4.1 | 1,918 | 1/25/2023 |
| 4.4.0 | 2,797 | 1/24/2023 |
| 4.3.4 | 1,911 | 1/23/2023 |
| 4.3.3 | 2,091 | 1/20/2023 |
| 4.3.2 | 1,937 | 1/19/2023 |
| 4.3.1 | 1,635 | 1/19/2023 |
| 4.3.0 | 2,424 | 1/18/2023 |
| 4.2.3 | 5,522 | 1/16/2023 |
| 4.2.2 | 8,967 | 1/11/2023 |
| 4.2.1 | 6,384 | 1/10/2023 |
| 4.2.0 | 1,867 | 1/10/2023 |
| 4.1.3 | 60,213 | 12/21/2022 |
| 4.1.2 | 21,379 | 12/1/2022 |
| 4.1.1 | 98,447 | 11/10/2022 |
| 4.1.0 | 140,571 | 10/13/2022 |
| 4.0.2 | 9,555 | 10/12/2022 |
| 4.0.1 | 16,724 | 10/11/2022 |
| 4.0.0 | 49,400 | 9/22/2022 |
| 3.10.0 | 201,471 | 9/20/2022 |
| 3.9.1 | 1,317,085 | 10/14/2021 |
| 3.9.0 | 334,676 | 6/25/2021 |
| 3.8.6 | 384,497 | 3/5/2021 |
| 3.8.5 | 24,346 | 2/23/2021 |
| 3.8.4 | 233,527 | 12/13/2020 |
| 3.8.3 | 2,333 | 12/10/2020 |
| 3.8.2 | 1,876 | 12/10/2020 |
| 3.8.1 | 30,439 | 11/6/2020 |
| 3.8.0 | 3,912 | 11/6/2020 |
| 3.7.7 | 310,761 | 6/25/2020 |
| 3.7.6 | 23,258 | 6/16/2020 |
| 3.7.5 | 14,073 | 6/8/2020 |
| 3.7.4 | 159,586 | 5/19/2020 |
| 3.7.2 | 3,685 | 5/18/2020 |
| 3.7.1 | 48,518 | 4/21/2020 |
| 3.7.0 | 46,667 | 4/19/2020 |
| 3.6.0 | 4,891,418 | 1/23/2020 |
| 3.5.3 | 12,328 | 1/8/2020 |
| 3.5.2 | 3,458 | 1/3/2020 |
| 3.5.1 | 2,167 | 12/31/2019 |
| 3.5.0 | 7,839 | 12/18/2019 |
| 3.4.3 | 7,011 | 12/16/2019 |
| 3.4.2 | 3,641 | 12/13/2019 |
| 3.4.1 | 2,102 | 12/11/2019 |
| 3.4.0 | 2,698 | 12/11/2019 |
| 3.3.11 | 6,780 | 12/1/2019 |
| 3.3.10 | 38,313 | 11/6/2019 |
| 3.3.9 | 183,916 | 8/15/2019 |
| 3.3.8 | 8,715 | 8/1/2019 |
| 3.3.7 | 2,104 | 8/1/2019 |
| 3.3.6 | 2,218 | 7/31/2019 |
| 3.3.5 | 30,132 | 7/5/2019 |
| 3.3.4 | 163,978 | 3/11/2019 |
| 3.3.3 | 20,124 | 2/1/2019 |
| 3.3.2 | 25,579 | 1/21/2019 |
| 3.3.1 | 4,488 | 1/14/2019 |
| 3.3.0 | 3,600 | 1/11/2019 |
| 3.2.6 | 2,788 | 1/11/2019 |
| 3.2.5 | 4,480 | 1/3/2019 |
| 3.2.4 | 8,852 | 11/21/2018 |
| 3.2.3 | 39,384 | 11/7/2018 |
| 3.2.2 | 5,288 | 10/30/2018 |
| 3.2.1 | 2,405 | 10/30/2018 |
| 3.2.0 | 3,053 | 10/24/2018 |
| 3.1.4 | 2,437 | 10/15/2018 |
| 3.1.3 | 2,288 | 10/15/2018 |
| 3.1.2 | 38,442 | 10/11/2018 |
| 3.1.1 | 2,770 | 10/4/2018 |
| 3.1.0 | 2,681 | 10/3/2018 |
| 3.1.0-preview-390 | 2,012 | 10/3/2018 |
| 3.1.0-preview-373 | 2,287 | 10/2/2018 |
| 3.0.5 | 8,856 | 8/13/2018 |
| 3.0.4 | 2,472 | 7/25/2018 |
| 3.0.3 | 2,310 | 7/25/2018 |
| 3.0.2 | 2,754 | 7/24/2018 |
| 3.0.1 | 2,304 | 7/24/2018 |
| 3.0.0 | 3,219 | 7/19/2018 |
| 2.1.4 | 85,782 | 6/7/2018 |
| 2.1.3 | 257,084 | 3/30/2018 |
| 2.1.2 | 371,835 | 1/10/2018 |
| 2.1.1 | 91,714 | 12/1/2017 |
| 2.1.0 | 2,649 | 11/29/2017 |
| 2.0.1 | 2,449 | 11/27/2017 |
| 2.0.0 | 3,318 | 11/27/2017 |
| 1.5.1 | 3,187 | 11/14/2017 |
| 1.4.0 | 6,521 | 10/23/2017 |
| 1.3.0 | 5,266 | 9/12/2017 |
| 1.2.139 | 3,351 | 9/6/2017 |
| 1.1.128 | 3,191 | 8/15/2017 |
| 1.0.114 | 2,596 | 7/31/2017 |
v1.5:
new features:
- map type is supported (#255)
- nested structures, repeated structures, repeated fields, nesting structures into structures etc. is supported (#226, #228, #227)
improvements:
- Parquet.Net is now a standalone library with no third-party dependencies whatsoever (#264, #265, #263)
v1.4
new features:
- data representation internally changed to columnar format, resulting in much smaller memory footprint and better performance (#238)
- added support for short/ushort CLR type (#235)
- breaking change: nullable columns are easier to define, parquet.net doesn't try to guess the nullability anymore and gives full control to the user
improvements:
- BigDecimal type supports much bigger numbers (scale and precision) (#239)
- Writer was failing on some forward-only streams like GZipStream as they don't track stream position, now parquet.net supports all kinds of non-seekable streams for write operations (#252)
- Decimal number format is now compatible with Impala (#243)
bug fixes
- Writer was failing on columns consisting of only null values (#222)
- When appending to file and using DateTime for one of your columns, subsequent appends would fail on schema validation (#247)
- Failure when deserialising Impala generated file with all nulls in a column (#240)
v1.3
new features:
- .NET byte and sbyte type is supported
- DataSet has got a new .Merge method that allows to merge two datasets, even if rows and columns are incompatible
improvements:
- we have removed a dependency on Snappy.Sharp completely which conflicted with projects targeting .NET 4.5
- dependency on System.ValueTuple is removed
- Apache Thrift dependency was replaced by a custom build which has zero downstream dependencies now. This was causing problems for projects using ASP.NET Core and specific Kestrel version, as stupidly enough Apache Thrift was referencing web hosting framework!
v1.2
new features:
- INT64 (C# long) type is supported (#194)
- Decimal datatype is fully supported (#209). This includes support for simple System.Decimal, and decimal types with different scales and precisions. Decimals are encoded by utilising all three encodings from parquet specs, however this can be switched off for compatibility with older system. Decimals are fully compatible with Hive and Impala which have some edge cases not complying with parquet specifications. Thanks to @dmitryPavliv and @nzapolski for making this possible
bugs fixed:
- fixed a flaw in dictionary encoding implementation affecting files written for AWS Impala (#193)
- when a column contains only single value and it's null Parquet.Net was crashing (#198)
v1.1
new features:
- Reader supports nested structures.
- Parquet output is now compatible with AWS Athena
- Writer can append data to existing file
improvements:
- Parquet metadata sets page sizes according to standard
- Schema and SchemaElement has Show method allowing to get user readable representation
bug fixes:
- some files mix encodings between data pages resulting in wrong count of rows and occasional crashes (#183)
- some string encoded fields not annotated properly were crashing Parquet.Net reader (#138)