This page is updated once daily (a couple of hours after midnight).

Number Of Web Pages In Australia

The number of pages in the Wallabyup databases on 12/04/2025 are;

Main Database:	78,475,234 pages
Invalid* Database:	11,007,539 pages
Inlinks** Database:	56,291 pages
Outlinks Database:	23,467,215 pages
Domains Database:	506,313 pages

^ bottom axis label is the last 45 days (day of the month). * pages in the Invalid Database record 404s, redirects, many non-Australian pages as invalid (e.g. *.co.uk sites), etc. Pages found a few months ago are deleted from the Invalid database to clear room.
** Inlinks Database is for new internal pages to crawl (not outlinks). In other words there are 56,291 queued pages to crawl.

Pages Per Day (crawled)

On the 11/04/2025 the WallabyupBot hit a grand total of 481,961 crawled pages for the day consisting of; - 158,064 recrawls of existing pages, - 205,422 invalid pages recorded, and - 118,475 new pages found.
^ bottom axis label is the last 45 days (day of the month).

Com.au, Gov.au, Org.au, and Net.au Pages Compared - Main Database

Page count of Australian top level domains listed in the Main Database;

Category	Pages	Percent
Com.au	49,107,186	62.6%
Gov.au	3,423,428	4.4%
Org.au	4,152,481	5.3%
Net.au	1,129,322	1.4%
Au* (e.g. csiro.au, wallabyup.au, etc.)	2,783,311	3.5%
Not ending in au (.com, .net, .org, .nz, etc.)	17,879,506	22.8%
Grand Total	78,475,234	100%

* excludes com.au, gov.au ,org.au, net.au.

Biggest Websites Online

Here are the largest websites in Australia (top 50 sites); Tally of page count in above table: 7,576,692 pages (10% of the Main Database).

Top 10 Websites With Errors

This lists the worst websites for errors. Shown are "host website at fault" in the Invalid Database*. At fault is defined by; page is offline, unsuccessful redirects (initiated by host), error code returned, empty pages, page is blocked to bots, or spam or parked pages. Tally of page count in above table: 485,801 pages (4% of Invalid Database).