When I first started researching Programmatic SEO, there were tons of great articles describing high-level concepts. None of those articles though, went into detail about actually building out a pSEO site. Especially for those with little-to-no programming skills (like me đ).
Fortunately, the no-code movement is upon us and the tools available today make it possible to hack together a Programmatic SEO tech stack without writing any code.
Today, I will run through the stack I used to recreate a pSEO use case (a Shopify app directory similar to what Preetam Nath built) and will now be using for some of my other side projects. This article is pretty comprehensive, so feel free to bookmark and finish this later.
Based on your targeted keywords, youâll first want to find a good resource to pull data. Some common sources and methods are as follows:
đ€ Scraping Websites
There are many tools that allow you to scrape useful data from websites. Make sure to avoid collecting intellectual property or personal information to ensure you donât run into legal issues.
đ Government Statistics and Data
Many governments around the world have open source data repositories for different industries. Hereâs a list of over 70 free data sources.
âđŒ Virtual Assistants
Online marketplaces such as Fiverr, Upwork, Freelancer, and Guru can be used to find virtual assistants all over the world who can collect and enter data for an affordable hourly rate.
đŸ Internal Data
If you already have an active community, marketplace, or e-commerce website you can potentially reuse your own data to build unique pages.
đ Data APIs
Although this would normally be better suited for builders with coding experience, there are tools such as NoCodeAPI that can be used to connect with APIs using no code.
Usually, most websites do not provide users with the functionality to save a copy of the data displayed on the web. The only option is for a person to manually copy-and-paste the data. Fortunately, web scraping can execute this process automatically.
Octoparse is the tool I chose for scraping the data. Itâs is a desktop-based app thatâs more robust than other scrapers Iâve tried and easier to setup workflows for collecting data. The free plan gives you a generous 10,000 records per export. Thatâs probably more than most people will need but you can always upgrade if youâre pulling down a ton of information.
Once you load the website that you want to scrape, you can set up a workflow that will click into multiple pages in sequence. From there, you can set the workflow to extract elements with the same HTML tags (text, image URLs, links, HTML, etc.) from each page by simply pointing and clicking on the data you want to pull. Once Octoparse completes its task workflow, you can download a CSV of all the data that youâve pulled.
Hereâs a collection of Octoparse alternatives.
Before you start to import your data into Airtable, you need to create matching copies of your Airtable database and Webflow CMS Collection to ensure the data syncs correctly. For example, if you scraped a Company Name, Website, and Logo Image URL you need to add the same data columns in both Airtable and Webflow.
Once youâve made the clone databases, you will want to manually enter a test item into your Webflow CMS Collection and export a CSV file. This will export some unique collection item data that Webflow automatically generates for any new database entry. Most importantly, you need the unique identification number for that record called an âItem IDâ.
Going back to Airtable, you need to add the new collection item data points that were generated by Webflow. These items include the âItem IDâ, âPublishâ, and âStatusâ columns. Using the CSV that was exported from Webflow, manually copy and paste that data into your Airtable database.
Now the syncing can begin. Using an extension called Nobull in Airtable, you can connect and sync between your Airtable and Webflow databases.
Once youâve linked up the two databases using Nobull, you can make a second test item in Airtable and rerun the sync. If all goes according to plan, you should see the new item show up in your Webflow CMS Collection.
Now you can begin to import your scraped data into Airtable and sync your data points into Webflow. Technically you could use the Webflow CMS Collection as your sole database, but Airtable is a much more flexible tool to manipulate and automate aspects of your data.
For my best Shopify apps directory, I have two tables housing the data. Table one is a comprehensive list of all the Shopify apps and their specific data points (see above). The second is a list of app categories that link to and classify the records in our first table (see below).
Hereâs a collection of Airtable alternatives.
Once you have your databases setup, you can start to create your Webflow CMS Collection page. Anytime you create a new item in a Collection, a page is automatically created for it. Collection pages work like templates â the layout and design of the Collection page applies to all automatically generated item pages.
You can design and develop the Collection page just like any other static page â but the power of Collection pages comes when you want to add dynamic content into that design. Just like with Collection lists, elements dropped into a Collection page are static until they are connected to a field from the Collection.
In my Shopify app example, I used a Collection list to populate a three column card grid. Once I set up the design for the first card, the other cards were automatically populated with the app information in that Collection. On top of this, Webflow will also automatically generate the app pages for each category as well.
Hereâs a collection of Webflow alternatives.
Webflow is great for SEO optimization and has a number of features that can help your website rank higher in search engine results pages. There are a variety of ways to improve your SEO using the inbuilt Webflow tools.
Mobile optimization ensures that mobile visitors have an experience optimized for their mobile device and takes into consideration site design, site structure, page speed and more to ensure a quality mobile user experience. Google provides some guidelines regarding mobile-friendly websites in which it mentions that only mobile-friendly websites will get more ranking than non-mobile-friendly websites.
Webflow was built for responsive design. It allows you to preview your site at different break points (desktop, tablet, mobile landscape, and mobile portrait) and make changes to the mobile views without altering the desktop view.
Meta titles and descriptions provide a text preview of your pageâs content. Compelling meta description copy can help drive more clicks. A high click-through rate, in turn, is a positive SEO factor. The more people click to your website â the more value Google believes that it provides â the higher it will rank.
The same method of dynamically pulling data from our Collections can be used to automatically populate the meta titles and descriptions on our programmatically generated pages. By adding these descriptions in Airtable and syncing to Webflow, you can include unique meta data for every page.
Title tags help both readers and search engines process the content of your page and understand how different pieces of information relate to one another. They capture the main topic and subtopics.
Adding relevant keywords to headers helps describe the page content better. But keywords alone wonât guarantee higher rankings. When creating page titles, think of usability over SEO. Assign proper H1, H2, and H3 titles to denote hierarchical levels of information.
Google verification allows you to verify ownership of a domain so you can use the Google Search Console tools. These tools give you access to Google search data and allow you to submit your sitemap so that your site is indexed in Google search results.
To add your website to the Google Search Console:
content=
). Donât close the window!In another browsing tab:
To verify your site:
You can enable the auto-generated sitemap of each project in the Project settings of that project. The setting is located in Project settings â SEO tab â Sitemap section. Make sure to save the changes and publish your site.
Once you've done that, Webflow will automatically generate the sitemap.xml of that project and update it each time you publish your site.
You can submit your sitemap through your Google Search Console. Choose the website you want to submit the sitemap of, then type âsitemap.xmlâ into the input field and press âsubmitâ.
In the hosting tab of your project settings, you can enable (or disable) a few features that will help speed up your website. Itâs a good SEO practice to enable all of these. This way, you can keep your website secured with an SSL and help speed up your websites by minifying HTML, CSS, and JS.
Programmatic SEO is a creative way to find your customers without competing with the big budget, big traffic sites. With a little technical savvy you can take advantage of this process, even with little-to-no coding skills. Hopefully this helps inspire some people.
If you're interested in the details of how I recreated this use case, I put it all together in a course that you can find here.