← Back to Papers

πŸ” Paper Discovery Pipeline

How 100+ candidates become 20 curated papers β€” visualized Dijkstra-style interactive

idle Β· press R to run
βœ“
Stage 1 Β· Source
🌐 OpenAlex API
5 research queries Γ— 30 papers
Input: 5 search queries targeting
Mamba, SSL/MIM, Segmentation, Shape, Foundation
Output: ~100–150 candidates
Filter: English only, has DOI
βœ“
Stage 2 Β· Filter
πŸ“‹ Rule Engine
deterministic Β· zero-cost
Rules:
β€’ Last 3 months only
β€’ Deduplication (DOI-based)
β€’ Remove previously collected
Output: ~50–80 papers
βœ“
Stage 3 Β· Embed
🧠 e5-small
intfloat/multilingual-e5-small Β· 384d
Input: title + abstract
Method: Multi-Anchor cosine similarity
(5 weighted anchors: Mamba 0.4, Seg 0.3, MIM 0.2,
Shape 0.05, Foundation 0.05)
+ Venue bonus + Citation bonus
Output: Top 30 by phase1 score
Cache: embeddings saved to disk (84KB)
βœ“
Stage 4 Β· Score
πŸ€– DeepSeek API
deepseek-chat Β· LLM relevance scoring
Input: Top 30 papers (title + venue)
Method: Batch prompt β€” rate each
paper 1–10 for medical image segmentation relevance
Blend: 70% DeepSeek + 30% phase1
Output: Top 20 final papers
βœ“
Stage 5 Β· Deploy
πŸš€ Publish
HTML β†’ VPS via SCP
Generate: Dark-themed HTML table
Deploy: SCP to betsy.monster
Schedule: Cron monthly (1st, 09:00 JST)
Priority: nice 19 + ionice idle
0
candidates found
0
survived rules
0
embedded & scored
0
curated papers
API / External Service
Local Compute
LLM Scoring
Output / Deploy
pipeline.log β€” example run
$ waiting for trigger…