Catalog ingestion & inventory sync
Shopify Product Scraping Automation
Full product automation engine for a sneaker/streetwear Shopify business, built to scrape, price, compare, process images, and sync catalog updates.
Role
Shopify Automation Developer
Duration
Published May 19, 2026
Impact
6-source scrape-to-Shopify pricing pipeline
About the Project
Built a full product automation engine for a sneaker and streetwear Shopify business. The system scrapes live inventory from six sources — ON Running, Kicksmachine, GOAT, HypeFly, CrepDogCrew, and Salomon — then applies USD to INR conversion, fixed import cost, and margin calculations before products move into the catalog workflow.
The comparison engine syncs scraped data against the live Shopify store in three operations: add new products, update price and inventory, and flag archive candidates. Images are automatically processed to a 700x700 white-background format before being pushed to Shopify through the Admin API.
Challenges Overcome
Normalizing product data across six different sneaker and streetwear sources.
Keeping currency conversion, import cost, and margin logic consistent before sync.
Preventing accidental Shopify catalog changes by separating add, update, and archive flows.
Processing product images into consistent 700x700 white-background assets before upload.
Tech Stack
Key Features
Scraped live inventory from ON Running, Kicksmachine, GOAT, HypeFly, CrepDogCrew, and Salomon
Automatic USD to INR conversion, fixed import cost, and margin calculation
Comparison engine for add new, update price/inventory, and archive-candidate workflows
700x700 white-background image processing before Shopify upload
Direct Shopify Admin API synchronization for catalog operations
Key Results
End-to-end product pipeline from source inventory to Shopify Admin API.
Reduced manual catalog entry, pricing updates, and image preparation work.
Three-operation comparison workflow makes catalog sync safer and easier to review.
Live product dashboard available at scrape-sync-pro.vercel.app.
Screenshots
04
