What you'll learn: The most common Hawaii website crawl blockers, how to find them in 30 minutes, and the specific fixes that get your pages back into Google's index.
Time to implement: 90 minutes to audit and fix.
Robots.txt, Meta Robots, and the Accidental Blocks
ACCIDENTALLY BLOCKING
Disallow: / (yes, the entire site — we see this regularly on staging sites that get pushed to production)
PROPERLY SCOPED
Disallow: /wp-admin/ + Disallow: /thank-you/ + Allow: /wp-admin/admin-ajax.php + Sitemap declaration
robots.txt and Meta Robots: The Two Crawl Switches
A robots.txt file tells crawlers what they can and cannot crawl. A meta robots tag on individual pages tells crawlers whether to index and follow links.Common Hawaii Site Crawl Issues
The most common Hawaii site issue: arobots.txt rule left over from site launch that still blocks /wp-admin/ but also accidentally blocks /wp-content/uploads/ (your images) or a whole section of your site. Or a meta noindex tag left on a page that is meant to rank.Audit Cadence That Actually Catches These
Run a site-wide crawl quarterly. Check every page for its meta robots directive. Check robots.txt for rules that do not belong.Internal Linking and Orphan Pages
If a page on your Hawaii site is not linked to from any other page, Google may never find it. Even if it is in your sitemap, Google prioritizes pages with inbound internal links. Every page should have at least 2-3 internal links pointing to it from relevant other pages.How to Fix Orphans on a Hawaii Site
Case studies should be linked from industry pages and service pages. Location pages should be linked from service pages and the locations hub. Orphans rank poorly. Fix them by adding real contextual links from pages that cover related Hawaii topics. Hawaii SEO is a monthly discipline, not a one-time project. Every client we serve from our Kaimuki-based team gets the same senior-led approach outlined in this article.URL Structure and Canonicalization
Good URL signals
- Lowercase, hyphen-separated
- Reflects content hierarchy: /services/seo/technical-seo/
- Stable forever (never change once published)
- Canonical points to itself
Bad URL signals
- ?id=12345 query strings as canonical
- Trailing slashes inconsistent across the site
- CamelCase or underscores instead of hyphens
- Duplicate URLs without canonical pointing to one
JavaScript Rendering and Hawaii Sites
Modern Hawaii websites increasingly rely on JavaScript for navigation, content, and even primary page content. Google does render JavaScript, but it costs crawl budget and delays indexing. For important Hawaii content (service pages, location pages, case studies), make sure the primary content is in the initial HTML response, not loaded by JavaScript after page load. Use the “View Source” test: if your service description is not in the raw HTML, Google is working harder to index it, and AI search platforms like ChatGPT may miss it entirely.FAQ
01How do I tell whether Google can actually crawl my page?
Use URL Inspection in Search Console and read the last crawl date.
- Discovered - currently not indexed, with a last crawl of Never, means Google knows the URL and has chosen not to fetch it.
- That is usually a trust or crawl budget judgment rather than a technical block.
- A genuine block shows up instead as blocked by robots.txt, or as a noindex tag.
Never crawled and blocked are different problems with completely different fixes.
02What is the most common crawl blocker on Hawaii small business sites?
A robots.txt rule left over from launch.
- Disallow slash, blocking the entire site, pushed live from staging. We see this regularly.
- Rules that block wp-content uploads, and therefore every image on the site.
- A meta noindex left behind on a page that is meant to rank.
Run a site-wide crawl quarterly and read the meta robots directive on every page.
03Does a page in my sitemap still need internal links?
Yes. A sitemap says a URL exists. Internal links say it matters.
- Google prioritizes pages carrying inbound internal links from relevant pages.
- Aim for at least two or three contextual links into any page that should rank.
- Orphan pages rank poorly even when they are submitted.
Being listed is not the same as being recommended.
