Case study · own platform, with a partner · Austria · only4sex.at · 18+

A national directory that updates itself twice a week.

An Austrian directory of venues in a regulated adult market, run by Meep Tech and a partner. It started as an old-school site where every listing was typed by hand. Now scrapers, a duplicate engine and a review queue keep it current — and a person only handles what the system isn’t sure about.

PipelineRunsReview queuepipeline · directory-at
Review queue3 flagged
Possible duplicateA #48213 ⇄ B #51077photos matchname differsMergeKeep both
147venues listed
2,354profiles kept current
67venue-specific scrapers
~40%of new profiles merged as duplicates automatically
01The problem

A directory is only worth something if it’s current.

Venues change their line-up all the time on their own websites. Typing those changes in by hand doesn’t scale past a handful of venues, and the same person often appears at several venues under slightly different names — so a hand-made directory is both out of date and full of duplicates.

02What we built

A pipeline that does the collecting and matching. People review what it can’t decide.

Four stages, each placed on the Autonomy Ladder. The system is at L2 overall: it runs on its own, and people review only the matches it can’t decide.

01

Collecting

L2 · runs on schedule
Before

Every venue and every profile was typed into the site by hand, and went out of date as soon as the venue changed its own page.

After

67 venue-specific scrapers, each reading one venue’s own profiles page. They run every Monday and Friday, or on demand, and bring in 100+ new profiles per run.

A personAdds a scraper when a new venue joins.

02

Matching duplicates

L2 · people decide the edge cases
Before

The same person appeared several times — once per venue, with slightly different names and photos.

After

Profiles whose photos match by hash merge automatically, on import and again in a nightly job — about 40 of the 100+ new profiles in each run. Anything uncertain goes to a review queue instead of being guessed.

A personClears the review queue: Merge or Keep both.

03

Staying within the rules

L3 · fully automatic
Before

No consistent rule for which sources could be imported.

After

Sources that put their own age verification or similar gate in front of profiles are skipped by design. The policy lives in code, not in someone’s memory.

A personNothing.

04

Reporting

L3 · people read one email
Before

No overview of what had changed since the last update.

After

After every run the admin receives one digest email listing the new, unchecked profiles. AI tools can read the live data through a read-only MCP server to answer questions about it — they can check, never change.

A personReads the digest.

03Using the data

The interface changed because of what visitors did, not guesses.

Search Console, Analytics and Microsoft Clarity heat maps showed where visitors looked and where they gave up. That led to mini galleries inside previews, a prompt offering alternatives when someone scrolls past a profile, and an endless feed of similar profiles in place of a fixed list.

04What didn’t work

Automation that guesses is worse than none.

A script that filled in missing venue data picked up favicons and tiny icons as venue logos, and mistook single-profile pages for venue pages. Those fields were cleared by hand and locked, and the script now only fills fields that are empty. An AI-based scraper for the same job filled a good share of the gaps but made too many mistakes to trust, so it isn’t used. Bulk AI-written profile text was considered and deliberately paused.

The rule that came out of it

Automate what can be checked, and send everything else to a person.

05Timeline

Built and run by one developer. First scraper in 11 days.

  1. First commit: project scaffold and server deploy
  2. First scraper running — 11 days in
  3. Scrapers reliable enough to sync the live site
  4. 50+ venues added in a month; interface reworked from heat-map data
  5. 147 venues, 2,354 profiles, runs every Monday and Friday
Next.jsVenue-specific scrapersPhoto-hash duplicate detectionReview queueRead-only MCPClaritySearch Console

Next step

Keeping data current by hand? Let’s find the one worth moving first.

Book a free 30-minute Autonomy Audit. We put your recurring processes on the ladder — no deck, no homework.