What is CrawlQ
CrawlQ is a content research and generator tool based on deep insights about your target market, audience, and your brand. It focuses on helping you to differentiate by creating value and addressing the important topics that your audience care about.
What’s different about it?
With any content generator tool, the common problem is poor output, and the reason you would hear from founders (and rightly so) is that it depends on the input you feed it. In other words: Garbage in → Garbage out.
CrawIQ allows you to feed the AI an insane amount of data about your market, audience, and your brand, so the natural expectation is that the output quality better be frigging high.
Quick heads up: As you start entering the first details. You’ll be prompted to enter the Workspace name (think: brand name) and the URL. Make sure to enter the full URL with https:// and not just www. as it’s absolutely vital for the system to analyze your website later on. Failure to do this will result in having to create another workspace and copy & paste everything over.
Once you’re in, you have 5 fundamental pillars to work with:
- Market Research
- Competitor Differentiation
- Topic Modelling: Once you know who your audience is, this is the next step: Topic clusters, Dominant Topic Discovery, Keywords, and Internal URL Topic Discovery (coming soon)
- Content Automation: don’t be tempted to jump in here first
- Search Engine Optimization
Tip: Spend some time playing around with the different tabs and test them out with 1-2 main keywords in your niche. It’ll help you understand how each feature works and what kind of output you can expect from it.
Feeding the tool with your insights
Once you’re ready to work on feeding the system with your market insights, start with the Niche section under Market Research. In there, spend as much time as you can to define the following:
- Niche Demographics
- Your product’s Emotional Hook
It’s worth noting that you don’t need to fill out everything at once to be able to start using the tool. You should keep adding more information over time. They will be used as a structural input to provide prompts to the GPT-3 or any kind of output available by CrawlQ. The more data is has to play with, the better the output that’s relevant to your niche. However, you can write the first few answers and ask the AI to generate the rest for you and manually refine those answers.
If you want to jump straight to the content topic, head over to Market Spying Wizard under Market Research and enter the topic keyword.
- The idea here is to help you to have a much, much deeper understanding of your topic.
- From the top-level topic keyword, you can narrow it down to the specific topic you want to focus on.
- Think of it as a detailed brainstorming tool.
- The left column is the channels that you can search for the keyword, eg: Podcasts, Social media, videos, etc.,
- If you click on any of the bubbles in the middle column, it’ll take you to the search result for that keyword.
Getting sidetracked: Unlock Insights
I was partly curious about this one since it’s highlighted in a bright red box (above screenshot), so like any procrastinators, I clicked on it, and this was what I saw 👇
Note: The questions were NOT written by me, but put together by CrawlQ as it scrapes the internet
It seems to pull information from the web about the specific questions your audience might have about the topic. Similar to doing research on Frase, or the “People also ask” section on Google SERP, but the fundamental differences are that:
- With Frase, you’d get the topics discussed by the top ranking sites for that keyword.
- The new shiny “Write FAQ” feature from Frase is also super helpful, but again, you’d have to click on “Write FAQ” from each of the top-ranking articles to generate.
- With this Insights feature from CrawIQ however, it’s grouped by the questions people ask around that topic, along with the answers. It is therefore a bit more natural when you process the information.
- In the People also ask section on Google, you only get 4 questions. To collect more information, you need to search for a different keyword every time.
Below are the Frequently Asked Questions generated from Frase. If you want to put this straight into your content, this is great. For research, however, CrawIQ provides a much deeper context.
To warp up: The Insights feature was a pleasant surprise and I will definitely head back to this when we do our research for the next piece of content. It gives you a starting point when you start diving into the topic of interest.
You’re not only understanding the subject in-depth, but you’re also understanding this subject related to your niche, your target audience, and their pain point.Harkish Kumar, CrawlQ founder
Note: After flipping back and forth, I noticed this status bar that wasn’t there before. A bit sad that I still have much to go, but definitely helpful to check progress though.
Other interesting features to check out
- Contextual Comparison Wizard: Compare URL to URL to identify gaps/opportunities to improve your content. Best for sales pages/product pages comparison.
- Organic Competition Wizard: Enter keywords + location (country) to identify competitors and get insights such as the semantic score in terms of quality of overall topic coverage.
The pitch, explained by CrawlQ: “Identify critical content gaps and find surefire ways to accelerate Topic Authority in search engines”
- Analyze your website and identify the topics that are a little light, whether it’s one of the blog posts, your About page, or one of the product pages.
- Ideally, this should be done before you start working on the automation, SEO… to take a look at your website and how the topics on your websites are connected.
This tool is best utilized when you have a team that is hands-on with content creation, as you likely would have gone through some parts of this process already with your team.
I went straight into the AI Content Writer for writing articles. From there, I was asked to provide some basic information. Here are the fields required and my answers (using one of the topics we’re writing):
- Main topic of interest: Newborn bath
- Enter initial content idea: How to bathe a newborn
- Select script: Authority Headlines, Authority Blog tools or Authority Meta description & title. I chose Authority Headlines
Then there were 4 options on the next page. I chose Advanced Power Profitable Words Title Scripts
Here are my answers on the next page. (I wrote this on the fly, so to all the moms reading this, please bear with me 🙏)
Below are the headlines that were generated.
Contrary to the instructions (choose or add your content relevant to your niche) I did not see an option to choose, so I went ahead and clicked on Proceed. This was what I got:
The right side of this page, which reminded me of Frase and the topic research part. It allows you to copy the headings & subheadings to the left and start building the article outlines, similar to Frase.
Under Paragraph, which essentially consists of snippets from the top ranking pages, there are 3 things you can do with each paragraph:
- Generate Questions
- Paraphrase or restructure the text so that it matches your SEO standards
- Copy text
Below are the questions generated from each snippet. The questions are pretty good, and I noticed that they’re different from the subheadings from the same article (screenshot above). I checked the original article but didn’t see where those questions might come from, so I’ll have to ask the folks at CrawlQ about how those questions were generated.
Unfortunately on the left, none of the copy made any sense apart from the headings. I watched 2 different videos about CrawIQ but it seems like at this point, you won’t be getting long form content “written for you” like other GPT-3 platforms such as ConversionAI, Shortly, Contentbot, Closerscopy, etc.,
The Generate Questions feature was good and Rephrase was decent, but the output from Frase’s new FAQ generator feature clearly trumps this at the moment.
Sales Copy Writing Wizard
I tried the Sales Copy Writing Wizard, but stopped because I was asked to fill out about 30 different questions to generate a sales copy. Not that this would mean this is a bad thing, but it means I would need to ask the CrawlQ team for a proper onboarding call to go through this.
Unfortunately due to the time constraint, I had to stop here. However, here are my verdicts so far on CrawlQ:
- It really is a unique tool: Somewhere between Frase and a GPT-3 powered copywriting tool.
- However, it’s the first tool that puts a huge focus on market research, rather than topic research like Frase and MarketMuse. As the result, you get really great insights about the audience intent.
- I still need to get in touch with CrawlQ to learn more about the content generation part, but at this point and subjectively, it still needs to improve a lot.
- Having said that, judging from:
- How impressive the research phase is and how much work goes behind it
- How much improvement was already made by the CrawlQ in the space of a few months
- And the recent success of Closerscopy, launching GPT-3 after their LTD launch
…I’m pretty confident that CrawlQ is a keeper for me. As for our team, I can see us using Frase and CrawlQ at the same time, even without the AI content generator: Frase for topic related research (to help us rank on Google) and CrawlQ for market research (to make sure our content have depth and cover the topics that people care about).
It’s definitely not a tool for everyone, as a large amount of input is needed. If you need to generate content fast, you’d be best to use other GPT-3 tools. However, as I mentioned above, the more data you feed CrawlQ, the higher the content quality. (I even noticed an improvement when asking the AI to generate my input to feed the system after the first hour).
Moreover, despite this seems like a ton of work up front, I know a lot of businesses and especially ad agencies who also go through this process in great details in the market research and copywriting research for their clients. The difference is that with CrawlQ, they’ve built out a tool for this purpose. In order to carve out an advantage in crowded niches, doing the hard work up front is a must and often times, it’s 100% worth it.
The founder Harish Kumar shared an article here where he walks us through the complete process from research to article with CrawlQ. Credit to Carl Angelo Tardecilla for sharing this.