JOBS
Async jobs
Million-row batches, deep crawls, and schedules. Download results or sink to your bucket (AssumeRole).
6
Supported platforms
3 types
Scenarios
3 ways
Delivery
3 tiers
Queue priority
Supported platforms
Batch async crawls across local services and e-commerce.
Taobao Flash Sale
Douyin Group Buy
JD.com
Meituan
DianpingScenarios
Batch crawl
Upload IDs or params_url; stream enqueue; priority queues.
Deep jobs
Multi-hop workflows with progress and failed-item retry.
Schedules
Cron templates for daily ranks and patrols.
Delivery
- Download
JSONL / CSV / Parquet on demand.
- Your bucket
S3/OSS with optional AssumeRole.
- Completion webhook
Notify your service on terminal status.
Queue priority
bulk / standard / priority affect wait time and price; wizard estimates before submit.
How it works
01
Create a job
Upload ID list or params_url, pick endpoint and priority.
02
Schedule & run
Stream enqueue, track progress, retry failed items.
03
Download / deliver
JSONL / CSV / Parquet download, or sink to your bucket and webhook.