We just made it much easier to load and host any HuggingFace dataset in Lilac, with no code!

Just provide the Lilac Deployer UI:
✅ HuggingFace dataset name
✅ Your HF access token

We will spin up a HuggingFace space with Lilac on that dataset.

huggingface.co/spaces/lilacai…

We just launched two new UI features:
✅ Compare two text fields and show a visual side-by-side diff
✅ Individual item-view mode, with arrow-key shortcuts

Demo: lilacai-lilac.hf.space/datasets#lilac…

Docs:
lilacml.com/datasets/datas…
lilacml.com/datasets/datas…

Databricks Secures Lilac AI Acquisition to Enhance LLM Training Data Quality

#Acquisition #AI #artificialintelligence #dataquality #Databricks #Gardentool #GenerativeAIapplications #LilacAI #llm #LLMtraining #machinelearning #Software

multiplatform.ai/databricks-sec…

We just released [email protected]!

This release brings in Monaco (the VSCode engine) to render documents, with powerful context menus for searching, labeling concepts, and more.

We also added UI support for common ChatML formats like ShareGPT

Release notes: github.com/lilacai/lilac/…

[email protected] is now released.

We now support:
- Loading custom embeddings
- Exporting directly to HuggingFace

Release notes: github.com/lilacai/lilac/…

New release: 0.1.25

This drops dask for a thin multi-processing client, and comes with lots of performance improvements, namely the slow import time of lilac.

We have also added a simpler API for loading from HuggingFace & some purple UI flare🪻

github.com/lilacai/lilac/…

Lilac AI sets a new horizon in data processing with Lilac Garden, offering up to 100x faster AI dataset transformations. A leap forward in efficient and rapid data handling. #DataScienceRevolution #LilacAI x.com/lilac_ai/statu…

lilac v0.3.5 released with support for Nomic AI 1.5 embeddings and BGE embeddings.

We've also made it easier to add text selections to concepts.

github.com/lilacai/lilac/…

In addition, I've worked with Nikhil Thorat and the Lilac team to cluster the datasets into clusters for analysis and further curation!

You can access the dataset in Lilac's Hugging Face
Spaces here: lilacai-lilac.hf.space/datasets#lilac…

And can access the clusters by clicking this button:

Lilac 0.2.1 now lets you speed-label or delete data with custom keyboard shortcuts.

I guess I wasn't kidding about the tinder UI.

github.com/lilacai/lilac/…

OpenHermes-2.5 dataset is finally here!

We're hosting the full dataset with pre-computed Lilac, joining Databricks! clusters in our demo.

Clusters: lilacai-lilac.hf.space/datasets#lilac…

Or group by the language

lilacai-lilac.hf.space/datasets#lilac…

Explore the GAIR-lima fine tuning dataset from the Mosaic blog post below using our Lilac Hugging Face space!

lilacai-lilac.hf.space/datasets#lilac…

We can do the same thing, grouping by the category

lilacai-lilac.hf.space/datasets#lilac…

We can also use clusters to understand what types of data came from which datasource by grouping by 'source'

Demo: lilacai-lilac.hf.space/datasets#lilac…

Curate better data for LLMs. Github: github.com/lilacai/lilac

'Databricks acquires Lilac AI to enhance data quality for generative AI applications.' #Databricks #LilacAI #AI #DataManagement
infoworld.com/article/371468…

Find us on GitHub: github.com/lilacai/lilac

jason liu github.com/lilacai/lilac by Nikhil Thorat is generating some buzz

Alex Volkov (Thursd/AI) Teknium open sources Hermes dataset
Announcement: x.com/teknium1/statu…
Dataset: huggingface.co/datasets/tekni…
Lilac: lilacai-lilac.hf.space/datasets#lilac…

Lilac announces Garden - LLM powered clustering for datasets
Announcement: x.com/lilac_ai/statu…