Drishti SDK is accessibility infrastructure — not an app. It's the layer that sits between your visual content and users who need non-visual access.

Visual Content (Image/PDF/Camera) 
        ↓
   Drishti SDK (Plugin Pipeline)
        ↓
┌───────┴───────┬─────────┬──────────┐
↓               ↓         ↓          ↓
📳 Haptics   🔊 Spatial Audio   🗣️ Voice   📝 Text

One SDK. Infinite plugins. Developers write plugins for new content types. Users get accessibility automatically.

┌─────────────────────────────────────────────────────────────┐
│                      drishti-core                            │
│  ┌──────────────┐  ┌──────────────┐  ┌──────────────────┐   │
│  │ Detector     │  │ Renderer     │  │ Pipeline         │   │
│  │ Registry     │  │ Registry     │  │ Orchestrator     │   │
│  └──────────────┘  └──────────────┘  └──────────────────┘   │
└─────────────────────────────────────────────────────────────┘
         ↑                    ↑                    ↑
    ┌────┴────┐        ┌─────┴─────┐        ┌─────┴─────┐
    │         │        │           │        │           │
┌───┴──┐ ┌───┴──┐ ┌────┴────┐ ┌────┴───┐ ┌───┴───┐ ┌────┴────┐
│Graph │ │Formula│ │Molecule│ │Circuit │ │Map    │ │ ...     │
│Plugin│ │Plugin │ │Plugin  │ │Plugin  │ │Plugin │ │ Plugins │
└──────┘ └───────┘ └────────┘ └────────┘ └───────┘ └─────────┘

Every content type is a plugin. No hardcoded modules. Contributors add support for new diagram types without touching core.

// settings.gradle.kts
dependencyResolutionManagement {
    repositories {
        google()
        mavenCentral()
        maven { url = uri("https://jitpack.io") }
    }
}

// build.gradle.kts
dependencies {
    // Core SDK
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-core:1.0.0")
    
    // Plugins (pick what you need)
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-graph:1.0.0")
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-formula:1.0.0")
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-molecule:1.0.0")
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-circuit:1.0.0") // future
    
    // Renderers
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-haptics:1.0.0")
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-audio:1.0.0")
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-voice:1.0.0")
    
    // Android integration
    implementation("com.github.LathissKhumar.DrishtiSTEM:drishti-android:1.0.0")
}

import io.drishti.core.Drishti
import io.drishti.graph.GraphPlugin
import io.drishti.formula.FormulaPlugin
import io.drishti.haptics.HapticsPlugin
import io.drishti.audio.AudioPlugin

// 1. Initialize with plugins
val drishti = Drishti.Builder()
    .addDetector(GraphPlugin())
    .addDetector(FormulaPlugin())
    .addRenderer(HapticsPlugin())
    .addRenderer(AudioPlugin())
    .build()

// 2. Read any visual content
val diagram = drishti.read(cameraFrame)  // or bitmap, or image file

// 3. Make it accessible
diagram.haptics()   // Feel the structure
diagram.audio()     // Hear the spatial layout  
diagram.voice()     // Get spoken description
diagram.explore()   // Interactive exploration mode

That's it. No AI expertise required.

Write your own plugin:

class MyCustomPlugin : DetectorPlugin {
    override val contentType = ContentType.CUSTOM("my-type")
    
    override fun detect(frame: Frame): List<ContentItem> {
        // Your detection logic
        return listOf(ContentItem(...))
    }
}

// Register
Drishti.Builder().addDetector(MyCustomPlugin()).build()

Input (Camera/Bitmap/File)
        │
        ▼
┌───────────────────┐
│  Vision Pipeline  │  ← drishti-vision (OpenCV, CameraX, preprocessing)
│  (shared across   │
│   all plugins)    │
└─────────┬─────────┘
          │ Frame + Features
          ▼
┌───────────────────┐
│  Detector Registry│  ← Parallel execution of all registered detectors
│  (Graph, Formula, │
│   Molecule, ...)  │
└─────────┬─────────┘
          │ ContentItems
          ▼
┌───────────────────┐
│  Scene Graph      │  ← Unified semantic representation
│  Builder          │
└─────────┬─────────┘
          │ SceneGraph
          ▼
┌───────────────────┐
│  Renderer Registry│  ← Parallel rendering to all outputs
│  (Haptics, Audio, │
│   Voice, Text)    │
└─────────┬─────────┘
          │ MultimodalOutput
          ▼
┌───────────────────┐
│  Drishti Diagram  │  ← Beautiful API: .haptics() .audio() .voice() .explore()
└───────────────────┘

1. Plugin-First — Every content type is a plugin. Core knows nothing about graphs, formulas, or molecules.
2. Offline-Only — No cloud calls. All ML runs on-device (LiteRT, ONNX, Sherpa-ONNX).
3. Developer Experience — 3-line quick start. Beautiful Kotlin API. Comprehensive docs.
4. Accessibility Infrastructure — Not a blind-assistance app. A layer any app integrates.
5. Modular Distribution — Each plugin publishes separately. Apps only pull what they need.
6. Real Implementations — No mocks, no placeholders, no TODOs. Production-grade.

DrishtiSTEM/
├── drishti-core/          # Plugin interfaces, registry, pipeline, scene graph
├── drishti-vision/        # Shared vision pipeline (OpenCV, CameraX, preprocessing)
├── drishti-graph/         # Graph detection plugin
├── drishti-formula/       # Formula OCR plugin
├── drishti-molecule/      # Molecule detection + PubChem plugin
├── drishti-haptics/       # Haptic rendering engine
├── drishti-audio/         # Spatial audio engine (Oboe)
├── drishti-voice/         # Voice assistant (Sherpa-ONNX)
├── drishti-android/       # Android HAL + CameraX integration
├── drishti-demo/          # DrishtiSTEM demo app (showcase)
└── examples/              # Integration examples

Each plugin is independently versioned and published to JitPack.

We make it easy to contribute:

1. Good First Issues — Each new diagram type is a separate plugin
2. No Core Touches — Add a detector without modifying core
3. Visual Feedback — Every PR includes a GIF of the plugin working

# Get started
git clone https://github.com/LathissKhumar/DrishtiSTEM
cd DrishtiSTEM
./gradlew build

See CONTRIBUTING.md for detailed guidelines.

• Architecture Guide
• Plugin Development
• API Reference
• Android Integration
• Building from Source

Apache License 2.0 — see LICENSE for details.

Copyright 2026 Drishti SDK Contributors.

• OpenCV — Computer vision foundation
• Oboe — Low-latency audio
• Sherpa-ONNX — Offline STT/TTS
• OpenChemLib — Chemistry toolkit
• mXparser — Math expressions
• Symja — Computer algebra