SCENE 01 / 06
SHANTANU.
AI & DEEP LEARNINGYEAR 2025

PLANT DISEASE AI.

COMPUTER VISION DIAGNOSTIC PLATFORM

PLANT DISEASE AI
AT-A-GLANCE SUMMARY (30-SEC RECRUITER SCAN)PROJECT METADATA
DURATION5 MONTHS
ROLEAI ENGINEER & FULL STACK DEVELOPER
TEAM SIZE3 ENGINEERS
STATUSPROTOTYPE V1.5
CORE TECH STACK
PYTORCHOPENCVFASTAPINEXT.JS 15TAILWIND CSS
01 / EXECUTIVE SUMMARY

WHAT & WHY

WHAT IT IS

An AI-powered computer vision diagnostic tool that scans crop leaf photos to identify fungal, bacterial, and viral plant pathogens with 96.4% accuracy.

TARGET AUDIENCE

Agronomists, agricultural researchers, and farmers requiring instantaneous field crop diagnostic analysis.

PROBLEM SOLVED

Eliminates multi-day lab testing delays by providing instant field diagnostics and treatment recommendations.

02 / THE PROBLEM

PAIN POINT & CONTEXT

Crop leaf pathogens spread rapidly, causing severe agricultural yield losses when diagnostic lab reports take days to process.

03 / OBJECTIVES

PROJECT GOALS

01

Train a deep CNN vision model with >95% classification accuracy across 38 pathogen classes.

02

Build a FastAPI inference server responding in sub-200ms.

03

Create an intuitive web scanner interface usable on field mobile devices.

04 / RESEARCH & PLANNING

USER INSIGHTS

INSPIRATION & BENCHMARKS

PlantVillage dataset research and precision agriculture automation.

KEY USER INSIGHTS

Field agronomists require offline-capable image capture and high-confidence heatmaps showing leaf damage regions.

05 / SOLUTION & KEY FEATURESPRODUCT CAPABILITIES

Trained a ResNet-50 Convolutional Neural Network fine-tuned on 54,000 leaf images, wrapped in FastAPI with a Next.js 15 UI.

01

INSTANT INFERENCE SCANNER

Drag-and-drop or camera snap diagnostic scanner with sub-200ms response.

02

GRAD-CAM HEATMAP VISUALIZATION

Highlights exact visual pixel regions driving the AI model's diagnosis.

03

TREATMENT RECOMMENDATION ENGINE

Provides actionable chemical and organic treatment steps based on pathogen severity.

06 / SYSTEM ARCHITECTURE

DATA PIPELINE & FLOW

Next.js frontend sends image payload to Python FastAPI backend running PyTorch model inference with Grad-CAM heatmap generation.

HIGH-LEVEL PIPELINE FLOW
Image Upload → OpenCV Preprocessing → PyTorch ResNet-50 → Grad-CAM Generator → JSON Response
07 / GROUPED TECH STACKTOOLS & PLATFORMS
frontend
Next.js 15React 19Tailwind CSS v4
backend
Python FastAPIUvicorn
database
PostgreSQL (Scan Logs)
ai Ml
PyTorchResNet-50OpenCVGrad-CAMAlbumentations
deployment
DockerAWS EC2 GPU Instance
tools
Jupyter NotebooksWeights & BiasesPostman
08 / DEVELOPMENT JOURNEY

BUILD TIMELINE

PHASE 01 — DATASET CURATION & AUGMENTATION

Curated 54,000+ augmented leaf images across 38 disease categories.

PHASE 02 — MODEL ARCHITECTURE & TRAINING

Trained ResNet-50 CNN model achieving 96.4% validation accuracy.

PHASE 03 — FASTAPI BACKEND & GRAD-CAM

Engineered sub-200ms inference server and visual heatmap generator.

PHASE 04 — WEB SCANNER UI INTEGRATION

Built mobile-responsive Next.js frontend with live camera scanner.

09 / TECHNICAL CHALLENGES

CHALLENGES & SOLUTIONS

CHALLENGE 01

Overfitting on specific field lighting conditions.

ENGINEERING SOLUTION

Applied aggressive Albumentations image transforms (color jitter, random shadows, rotation).

CHALLENGE 02

Slow GPU inference cold starts on cloud API instances.

ENGINEERING SOLUTION

Containerized model runtime with ONNX Runtime CPU/GPU execution provider.

10 / RESULTS & IMPACT

SYSTEM OUTCOMES

Achieved 96.4% test set classification accuracy across 38 pathogen categories.

Sub-180ms total inference response time.

Successfully evaluated on over 1,500 real field crop samples.

11 / RETROSPECTIVE

LEARNINGS & ROADMAP

KEY LEARNINGS

Deep learning models in production require visual interpretability (Grad-CAM) to gain domain expert trust.

FUTURE ROADMAP (V2.0)

  • Edge deployment via ONNX Mobile for 100% offline field scanning.
  • Drone telemetry integration for large-scale aerial crop scanning.
  • Multi-spectral imagery support.
INTERESTED IN BUILDING SOMETHING SIMILAR?

LET'S WORK TOGETHER

GET IN TOUCH
SHANTANU. — Product Engineer & Designer Portfolio