Aella Science Dataset Explorer
Interactive visualization and exploration of scientific papers from the Aella open science dataset.
This project is a collaboration between Inference.net and LAION. LAION curated the original dataset which is about ~100m scrapped scientific and research articles and Inference.net fine-tuned a custom model to extract structured summaries from the articles. This repo contains a visual explorer for a small subset of the extracted dataset.
View the live explorer at https://aella.inference.net.
Overview
A web application for exploring scientific papers with semantic embeddings, dimensionality reduction, and clustering visualizations.
Architecture
- Frontend: React + TypeScript + Vite with D3.js for interactive visualizations
- Backend: Python FastAPI serving data from SQLite (D1 in production)
- Storage: SQLite locally, Cloudflare D1 + R2 in production
Prerequisites
You'll need the following tools installed:
- Python 3.11+ - Download
- uv - Python dependency management - Install
- bun - JavaScript runtime - Install
- Task - Task runner - Install
Setup
Install all dependencies:
task setup
This will install both backend and frontend dependencies.
Quick Start
1. Get the Database
Download the database from R2:
task db:setup
This will download the SQLite database to backend/data/db.sqlite.