[FREE] Listings Crawler — Osclass Plugin for Crawling & Importing External Listings

Alpha37

Member
XNullUser
Joined
Feb 25, 2022
Messages
45
Reaction score
24
Points
8
NullCash
144
Listings Crawler is a free plugin for Osclass 8.x that lets you automatically extract classified listings from any external website and import them directly as real listings on your own site.

I built this from scratch for my own Osclass install and decided to release it for free.

Features
CSS selector mapping — point the plugin at any field on any page using standard CSS selectors
Two extraction modes:
Links mode — collects listing URLs from a list page, then visits each one to extract the full data
Direct mode — extracts everything straight from the listing cards on the list page, no extra requests
25+ supported fields — title, description, price, currency, images, location (country/region/city), contact details, vehicle and property attributes, and more
Custom extra fields — define any additional field with a custom label and selector
Pagination support — follows "Next page" links automatically across multiple pages
URL Analyzer — test whether your server can reach the target URL and inspect its HTML structure before setting up selectors
Duplicate detection — skip, update, or always re-import based on a URL hash check
Dual storage — JSON files (default, lightweight) or MySQL database
Direct import — import pending items as real Osclass listings in one click, individually or in bulk
Cron scheduling — run crawlers automatically hourly, daily, or weekly, via Osclass built-in cron or an external cron URL secured by a private token
User assignment — assign imported listings to an existing user, or auto-create a new user per listing

Requirements
Osclass 8.0 or higher (tested on 8.3.1)
PHP 7.4+ with curl and dom extensions enabled
The target site must be reachable from your server (standard HTML pages — JavaScript-rendered or bot-protected sites are not supported)
Installation
Download and unzip
Upload the listings-crawler folder to /oc-content/plugins/
Activate from Admin → Plugins
Go to Plugins → Listings Crawler and accept the license on first use
 

Attachments

  • listings-crawler.zip
    59.8 KB · Views: 5

stoic

Member
XNullUser
Joined
Nov 22, 2025
Messages
75
Reaction score
22
Points
8
Location
Caribbean
NullCash
42
This is one of those hard to find plugins that we all will be sure to test thoroughly before committing to a price, version, etc.. Thanks.
 
Top