Sohaib Hayder
Educator
Sohaib Hayder is a professionally trained educator with a learner-first approach to digital education, curriculum development, and knowledge delivery. His review work focuses on structure, clarity, and making complex SEO and technical concepts genuinely transferable to readers.
Articles
How Web Crawlers Work: Seeds, URL Frontiers & Crawl Rate
A web crawler is a program that discovers pages on the web by fetching URLs, reading their HTML, extracting links, and adding those new links to a queue of pages to visit next. Tha...
Crawl Strategies Explained: Breadth-First, Depth-First, and Focused Crawling
A web crawler's strategy determines which pages it discovers and in what order. The three foundational approaches (breadth-first, depth-first, and focused crawling) produce radically different outcomes from the exact same seed URL....
The robots.txt Protocol Explained: History, Syntax, Logic, and Real-World Traps
robots.txt is a plain text file at the root of a domain that instructs web crawlers which paths they are permitted to fetch. Proposed by Dutch software engineer Martijn Koster in February 1994 and refined into an IETF standard 28...
Hubs and Authorities: How Kleinberg’s HITS Algorithm Explains Why Niche Links Beat Generic Ones
Published the same year as PageRank, HITS computes two scores per page iteratively: an authority score (pages pointed to by many good hubs) and a hub score (pages that point to many good authorities). The eigenvector update converges to a stable ranking. HITS explains why topical link clusters matter, and why a link from a domain authority in your niche outweighs a generic high-PR link.
Crawl, Index, Rank: The Search Engine Pipeline That Decides Whether Your Page Exists to Google
Google officially describes three stages: crawling (URL discovery and page fetching), indexing (analysis and storage), and serving (ranking and result delivery). This lesson treats the pipeline as an engineering system with inputs, processes, queues, and failure modes, not just a list of stages. Understanding the whole system before studying each part prevents the tunnel-vision that most SEO courses suffer from.
Learning-to-Rank: How Machine Learning Replaced the 200-Factor Checklist
Modern search engines don't hard-code ranking rules, they train machine-learning models on query-document pairs. The learning-to-rank (LTR) field divides into three approaches: pointwise (score each document independently), pairwise (learn which of two documents is better), and listwise (optimise the entire ranked list). RankNet (2005) was the first major neural pairwise model. This lesson introduces the framework that modules 4.4 and 4.5 build on.
JavaScript SEO Explained: Googlebot's Two-Phase Crawl, SSR, and Dynamic Rendering
Googlebot can execute JavaScript. That fact alone has misled more development teams than almost any other statement in SEO. The ability to render is not the same as reliable, timely indexing. Googlebot crawls and renders in two...
Internal Link Architecture Explained: Hub-and-Spoke, Link Depth, and PageRank Flow
Site architecture is the mechanism by which a website distributes two resources that are always finite: PageRank and crawl budget. Every internal link is both a crawl pathway and an authority transfer. The hub-and-spoke model...
