{"slug": "papers-with-code-is-now-open-source", "title": "Papers with Code is now open-source", "summary": "Hugging Face has released an open-source rebuild of Papers with Code, the research catalog Meta retired in 2025, now live at paperswithcode.co. The rebuild keeps the original Papers with Code API client compatible through a REST API under /api/v1/, and imports papers, code, models, datasets and leaderboards automatically from Hugging Face, arXiv, GitHub and public leaderboards. The stack runs on Python 3.12 with FastAPI, React 18 with TypeScript, and PostgreSQL 16 using the vector and pg_trgm extensions, with hybrid lexical and semantic paper search and an optional research chat grounded in the catalog via Papers with Code MCP tools.", "body_md": "Papers with Code makes open AI research and its artifacts accessible: papers, code, models, datasets, tasks, methods, and benchmark leaderboards. It recreates the original paperswithcode.com, which Meta retired in 2025, and keeps it up to date with automated imports from Hugging Face, arXiv, GitHub, and public leaderboards.\n\n**Live site:** [https://paperswithcode.co](https://paperswithcode.co)\n\n- **Paper catalog.** arXiv and external papers with official code, project\npages, Hugging Face models, datasets, and Spaces, plus thumbnails, TL;DRs,\nlineage, and a Markdown reader.\n- **Taxonomy.** Browsable tasks, methods, datasets, frameworks, conferences,\norganizations, and authors, with trending views.\n- **Leaderboards.** Paper-native evaluation results on benchmarks, plus\nscheduled syncs of external leaderboards.\n- **Search.** Hybrid lexical (`pg_trgm` ) and semantic (`pgvector` ) paper\nretrieval.\n- **Public API.** A REST API under`/api/v1/` that stays compatible with the\noriginal[Papers with Code API client](https://github.com/paperswithcode/paperswithcode-client) .\nOpenAPI docs are served at`/docs` .\n- **Research chat (optional).** An assistant grounded in the catalog through the\nPapers with Code MCP tools.\n- **Curation automation.** Scheduled jobs and agent workflows import daily\npapers, link tasks and methods, refresh stars and citations, and propose\nevaluations.\n\n| Layer | Technology | \n|---|---|\n| Frontend | React 18, TypeScript, Vite, TanStack Query, shadcn/ui, Tailwind CSS | \n| Backend | Python 3.12, FastAPI, SQLAlchemy 2, Pydantic | \n| Database | PostgreSQL 16 with the `vector` and`pg_trgm` extensions | \n| Tooling | [uv](https://docs.astral.sh/uv/) , npm, Ruff, pytest | \n| Hosting | nginx serving immutable releases ( [deploy/](https://github.com/huggingface/paperswithcode/blob/main/deploy) ) | \n\n| Path | Contents | \n|---|---|\n| [`backend/`](https://github.com/huggingface/paperswithcode/blob/main/backend) | FastAPI app ( `main.py` ),`routers/` (HTTP adapters),`services/` (domain logic),`models/` (API models;`models/database/` for SQLAlchemy models),`database/migrations/` (SQL migrations),`cli.py` (the`pwc` maintenance CLI), and`tests/` | \n| [`frontend/`](https://github.com/huggingface/paperswithcode/blob/main/frontend) | React single-page app | \n| [`deploy/`](https://github.com/huggingface/paperswithcode/blob/main/deploy) | Release, rollback, nginx, systemd, and environment templates for the hosted site | \n| [`.github/workflows/`](https://github.com/huggingface/paperswithcode/blob/main/.github/workflows) | CI and scheduled data jobs; job scripts live in `scripts/` | \n| [`jobs/`](https://github.com/huggingface/paperswithcode/blob/main/jobs) | Paper-curation runner for Hugging Face Jobs | \n| [`docs/`](https://github.com/huggingface/paperswithcode/blob/main/docs) | Development, data, database, and operations guides | \n\n```\ngit clone https://github.com/huggingface/paperswithcode.git\ncd paperswithcode\nuv sync\ncd frontend && npm install && cd ..\ncreatedb paperswithcode\npsql -d paperswithcode -c 'CREATE EXTENSION vector' -c 'CREATE EXTENSION pg_trgm'\n```\n\nSettings are read from `PWC_`-prefixed environment variables (see\n[`backend/config.py`](https://github.com/huggingface/paperswithcode/blob/main/backend/config.py)). Put them in `backend/keys.env`,\nwhich git ignores:\n\n```\nPWC_DB_HOST=localhost\nPWC_DB_PORT=5432\nPWC_DB_NAME=paperswithcode\nPWC_DB_USER=postgres\nPWC_DB_PASSWORD=\nPWC_ENVIRONMENT=development\n\n# Optional: higher Hugging Face and GitHub rate limits for imports\nPWC_HF_TOKEN=\nPWC_GITHUB_TOKEN=\n```\n\nChat, curation, and hosted integrations need more credentials; the\ntemplates in [`deploy/env/`](https://github.com/huggingface/paperswithcode/blob/main/deploy/env) list them.\n\n```\nuv run --env-file backend/keys.env python -m backend.database.connection init\nuv run --env-file backend/keys.env backend/run_server.py   # API on http://localhost:8000\ncd frontend && npm run dev                                   # app on http://localhost:8080\n```\n\nThe Vite dev server proxies `/api` to the backend on port 8000. The schema\nstarts empty; use the `pwc` CLI below to index papers.\n\n```\nuv run pytest backend/tests/paper -q    # run the suite you touched\ncd frontend && npm run lint\n```\n\nTests that need PostgreSQL refuse to run unless `PWC_TEST_DATABASE=1` points\nthem at a disposable database. The\n[development guide](https://github.com/huggingface/paperswithcode/blob/main/docs/development-guide.md) lists the test suites and\nconventions. [pre-commit](https://pre-commit.com/) runs Ruff on each commit;\nrun `pre-commit install` once to enable it.\n\n`uv sync` installs a `pwc` command for catalog maintenance. Run\n`uv run pwc --help` for the full list. Common commands:\n\n```\nuv run --env-file backend/keys.env pwc paper index 1706.03762    # index or refresh an arXiv paper\nuv run --env-file backend/keys.env pwc paper info 1706.03762\nuv run --env-file backend/keys.env pwc search \"vision-language models\"\nuv run --env-file backend/keys.env pwc paper add-external https://example.org/research\nuv run --env-file backend/keys.env pwc benchmark add \"ExampleBench\" \\\n  --task question-answering --metric Accuracy --source-paper 2501.12345\nuv run --env-file backend/keys.env pwc thumbnail 1706.03762      # regenerate a thumbnail\nuv run --env-file backend/keys.env pwc cron health               # scheduled-job health\n```\n\nFor read-only access to the public catalog from any machine, install the\nstandalone [`pwc-cli`](https://github.com/huggingface/pwc-cli):\n\n```\nuv tool install 'git+https://github.com/huggingface/pwc-cli.git#subdirectory=standalone_cli'\n```\n\npaperswithcode.co runs production and staging as immutable releases behind\nnginx; see [docs/deployment.md](https://github.com/huggingface/paperswithcode/blob/main/docs/deployment.md) and\n[docs/operations.md](https://github.com/huggingface/paperswithcode/blob/main/docs/operations.md). Durable artifacts live in private\nHugging Face buckets in the `huggingface` organization:\n\n| Bucket | Purpose | Setting | \n|---|---|---|\n| `huggingface/pwc-papers-content` | Paper Markdown used by the reader and `pwc paper read` | `PWC_PAPER_MARKDOWN_HF_BUCKET_ID` | \n| `huggingface/pwc-thumbnail` | Generated paper thumbnails | `PWC_THUMBNAIL_HF_BUCKET_ID` | \n| `huggingface/pwc-paper-embeddings` | Embedding exports and experiments | `hf://buckets/huggingface/pwc-paper-embeddings/...` | \n| `huggingface/paperswithcode-backups` | Database backups | `PWC_POSTGRES_BACKUP_BUCKET` | \n\n- [docs/development-guide.md](https://github.com/huggingface/paperswithcode/blob/main/docs/development-guide.md) : conventions, test suites, and local checks\n- [docs/public-api.md](https://github.com/huggingface/paperswithcode/blob/main/docs/public-api.md) : the public REST API\n- [docs/database.md](https://github.com/huggingface/paperswithcode/blob/main/docs/database.md) : database access and security\n- [docs/DATABASE_SCHEMA_UML.md](https://github.com/huggingface/paperswithcode/blob/main/docs/DATABASE_SCHEMA_UML.md) : schema reference\n- [docs/data-workflows.md](https://github.com/huggingface/paperswithcode/blob/main/docs/data-workflows.md) : datasets, evaluations, metrics, and tasks\n- [docs/operations.md](https://github.com/huggingface/paperswithcode/blob/main/docs/operations.md) : scheduled jobs and monitoring\n- [docs/deployment.md](https://github.com/huggingface/paperswithcode/blob/main/docs/deployment.md) : releases, nginx, and smoke checks\n- [.github/workflows/scripts/README.md](https://github.com/huggingface/paperswithcode/blob/main/.github/workflows/scripts/README.md) : scheduled job scripts\n- [AGENTS.md](https://github.com/huggingface/paperswithcode/blob/main/AGENTS.md) : instructions for coding agents\n\nPlease report vulnerabilities privately; see [SECURITY.md](https://github.com/huggingface/paperswithcode/blob/main/SECURITY.md).\n\nPapers with Code is licensed under the [Apache License 2.0](https://github.com/huggingface/paperswithcode/blob/main/LICENSE).", "url": "https://wpnews.pro/news/papers-with-code-is-now-open-source", "canonical_source": "https://github.com/huggingface/paperswithcode", "published_at": "2026-10-27 09:03:40+00:00", "updated_at": "2026-10-27 09:11:48.533321+00:00", "lang": "en", "topics": ["ai-research", "machine-learning", "artificial-intelligence", "agent-protocols", "developer-tools"], "entities": ["Hugging Face", "Papers with Code", "Meta", "arXiv", "GitHub", "PostgreSQL", "FastAPI", "React"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/papers-with-code-is-now-open-source", "markdown": "https://wpnews.pro/news/papers-with-code-is-now-open-source.md", "text": "https://wpnews.pro/news/papers-with-code-is-now-open-source.txt", "jsonld": "https://wpnews.pro/news/papers-with-code-is-now-open-source.jsonld"}}