Etl.Net 1.0.161-alpha

Mass processing data with a complete ETL for .net developers

This is a prerelease version of Etl.Net.
Install-Package Etl.Net -Version 1.0.161-alpha
dotnet add package Etl.Net --version 1.0.161-alpha
<PackageReference Include="Etl.Net" Version="1.0.161-alpha" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add Etl.Net --version 1.0.161-alpha
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Release Notes

ETL.net

Implementation of a multi platform reactive ETL for .net standard 2.0 working with a similar principle than SSIS, but that is used in the same way than Linq.
The reactive approach for the implementation of this engine ensures parallelized multi streams, high performances and low memory foot print even with million rows to process.

ETL Operators:
* Select Transformation
* Where Transformation
* Sort Transformation
* Left Join Transformation
* Lookup Transformation
* Union Transformation
* Skip Transformation
* Top Transformation
* Distinct Transformation
* Pivot Transformation
* Unpivot Transformation
* Aggregate Transformation
* Cross Apply Transformation
* Ensure Sorted Transformation
* Ensure Keyed Transformation
* Script Transformation
* Select keeping sorted Transformation
* Left join keeping sorted Transformation
* Lookup keeping sorted Transformation
* List folder files Data source
* Read csv file Data source
* Read excel file Data source
* Write csv file Data destination
* Write excel file Data destinaton (to be done)
* Read from Entity framework core Data source
* Write to Entity framework core Data destination
* Read from Entity framework Data source (to be done)
* Write to Entity framework Data destination (to be done)
* Entity framework core upsert Data destination
* Entity framework upsert Data destination (to be done)
* SQL Server bulk load Data destination (to be done)
* Read from sql server command Data source
* Write to sql server command Data destination
* List files from FTP Data source
* List file from SFTP Data source
* Read files from FTP Data source
* Read file from SFTP Data source
* Write files from FTP Data destination
* Write file from SFTP Data destination
* Read data from REST service Data source (to be done)
* Write data to REST service Data destination (to be done)
* Keep section Transformation
* Ignore section Transformation

Runtime features:
* Trace issued data of each node
* Trace any error
* Stop the entire process whenever an error is raised
* Trace statistic result of each node at the end of the process
* Trace time that is spent in each node at the end of the process (to be done)
* Publish a Job as a REST web service in web api core (to be done)
* Run any ETL operation on traces to permit to filter and save
* Show realtime process execution statistics as a sankey graph
* Web portal to host job definitions manage their executions (to be done)
* Power shell command tool to execute a job (to be done)
* Visual studio code addon to view the process as a sankey graph whenever the job definition class file is saved (to be done)
* Raise a warning on the risky node when a performance issue or a bad practice is detected given statistics (to be done)
* Interprets a T-SQL-like language script to build a job definition on the fly and run it (to be done)

  • .NETStandard 2.0

    • No dependencies.

NuGet packages (8)

Showing the top 5 NuGet packages that depend on Etl.Net:

Package Downloads
Etl.Net.ExecutionPlan
ExecutionPlan extensions for Etl.Net
Etl.Net.EntityFrameworkCore
EntityFrameworkCore extensions for Etl.Net
Etl.Net.TextFile
Text files extensions for Etl.Net
Etl.Net.ExcelFile
Excel files extensions for Etl.Net
Etl.Net.SqlServer
Sql Server extensions for Etl.Net

GitHub repositories

This package is not used by any popular GitHub repositories.

Version History

Version Downloads Last updated
1.0.161-alpha 354 3/7/2019
1.0.160-alpha 279 2/23/2019
1.0.159-alpha 271 2/20/2019
1.0.158-alpha 276 2/14/2019
1.0.157-alpha 259 2/9/2019
1.0.155-alpha 269 1/31/2019
1.0.152-alpha 263 1/22/2019
1.0.151-alpha 272 1/3/2019
1.0.150-alpha 267 12/30/2018
1.0.146-alpha 279 12/28/2018
1.0.144-alpha 240 12/27/2018
1.0.143-alpha 263 12/27/2018
1.0.142-alpha 249 12/26/2018
1.0.141-alpha 233 12/26/2018
1.0.140-alpha 287 11/21/2018
1.0.139-alpha 249 11/18/2018
1.0.138-alpha 267 11/18/2018
1.0.137-alpha 240 11/18/2018
1.0.136-alpha 230 11/18/2018
1.0.135-alpha 269 11/13/2018
1.0.134-alpha 276 11/12/2018
1.0.133-alpha 244 11/11/2018
1.0.132-alpha 248 11/4/2018
1.0.131-alpha 242 10/18/2018
1.0.130-alpha 270 10/16/2018
1.0.129-alpha 320 10/16/2018
1.0.128-alpha 260 10/1/2018
1.0.127-alpha 265 10/1/2018
1.0.126-alpha 241 9/30/2018
1.0.125-alpha 271 9/30/2018
1.0.124-alpha 259 9/28/2018
1.0.123-alpha 275 9/26/2018
1.0.122-alpha 268 9/25/2018
1.0.121-alpha 265 9/25/2018
1.0.120-alpha 259 9/25/2018
1.0.118-beta 260 9/25/2018
1.0.116-beta 257 9/25/2018
1.0.114-beta 257 9/25/2018
1.0.111-alpha 248 9/22/2018
1.0.109-alpha 250 9/21/2018
1.0.108-alpha 255 9/19/2018
1.0.107-alpha 269 9/16/2018
1.0.106-alpha 255 9/14/2018
1.0.105-alpha 289 9/14/2018
1.0.104-alpha 230 9/12/2018
1.0.103-alpha 259 9/12/2018
1.0.102-alpha 227 9/10/2018
1.0.101-alpha 235 9/10/2018
1.0.100-alpha 229 9/10/2018
1.0.99-alpha 241 9/10/2018
1.0.98-alpha 233 9/10/2018
1.0.97-alpha 271 9/10/2018
1.0.96-alpha 210 9/8/2018
1.0.95-alpha 227 9/6/2018
1.0.93-alpha 228 9/3/2018
1.0.88-alpha 241 9/2/2018
1.0.86-alpha 222 9/2/2018
1.0.85-alpha 179 9/2/2018