heystack

"git for data" FOSS tools

link source: https://news.ycombinator.com/item?id=26370863

From the heystacks.com archiveUpdated 133 views
Open original
View as text

Created and Maintained by Joseph Jacks (OSS Capital) and Justin Cormack (Docker) in early December 2020

Criteria: This sheet lists FOSS technologies (and COSS companies if they exist) which focus on creating "git for data" solutions in various domains.

COSS CompanyKnown Funding (M)FOSS TechnologyStarsLaunchedStatusFocusDescriptionLead Creator/PM
--https://github.com/datahuborg/datahub200~September 2013Dormantdata collaborationData collaboration platformhttps://twitter.com/anantpb
AERGO$30https://github.com/aergoio/litetree1,400~August 2018DormantsqliteBranch and merge SQLitehttps://twitter.com/aergo_io
Attic Labs$8https://github.com/attic-labs/noms7,300~May 2018DormantDatabaseDeclarative content addressed databasehttps://twitter.com/aboodman
DoltHub$5https://github.com/dolthub/dolt2,000~December 2018ActiveSQLVersion SQL tables, merge, branch. Hosted hub for public data.https://twitter.com/timsehn
Dotscience$10https://github.com/dotmesh-oss/dotmesh500~February 2018DormantMLOriginally general purpose versioned data, pivoted to replicatable experimentshttps://twitter.com/lmarsden
GitLab$434https://gitlab.com/meltano/meltano400~July 2018ActiveETLOrchestration of ELT pipelineshttps://twitter.com/DouweM
Gretel.ai$16https://github.com/gretelai/gretel-synthetics100~March 2020Activedata generationSynthetic privacy preserving data generationhttps://twitter.com/AlexWatson405
Grist Labs-https://github.com/paulfitz/daff550~January 2013DormantDiffData diff toolhttps://twitter.com/fitzyfitzyfitzy
Grist Labs-https://github.com/gristlabs/grist-core20~May 2020ActiveSpreadsheetVersioned spreadsheethttps://twitter.com/fitzyfitzyfitzy
Iterative$4https://github.com/iterative/dvc6,800~March 2017ActiveMLGit/Git LFS and Makefiles for ML and data sciencehttps://twitter.com/rkuprieiev
Pachyderm$28https://github.com/pachyderm/pachyderm4700~October 2014Activedata scienceVersion controlled data ingestion and processing pipelinehttps://twitter.com/jdoliner
Qri-https://github.com/qri-io/qri1,000~October 2016Activedata managementDataset version controlhttps://twitter.com/b_fiive
Quilt Data$4https://github.com/quiltdata/quilt1,000~Febrary 2017ActiveML/dataVersioning for small and large data that don't fit in git eg ML models. S3/AWS based.https://twitter.com/akarve
Replicate-https://github.com/replicate/replicate500~August 2020ActiveMLVersion ML models, focus on simpler workflows and introducing people to version controlhttps://twitter.com/bfirsh
Tarides-https://github.com/mirage/irmin1,400~August 2017ActiveBlockchain/generalGit for merging distributed data models. OCaml. Used by Tezos.https://twitter.com/eriangazag
TerminusDB$1https://github.com/terminusdb/terminusdb1,000~May 2019ActiveDatabaseRevision controlled graph databasehttps://twitter.com/GavinMGleason
Treeverse-https://github.com/treeverse/lakeFS500~September 2019Activedata managementVersioned data lake for ETL and data sciencehttps://twitter.com/lakeFS
XetHub$7.5M???Activedata management

Discussion 0

0/5,000

No discussion yet. Start it — no sign-up needed.