Driving better SEO strategies requires reliable access to data and insights. At SE Ranking, we prioritize two key elements from this statement: high-quality data and your trust. That’s why we’ve made significant upgrades to our Compe،ive Research Tool, resulting in:
- 30% more keywords in our Compe،ive Research databases compared to 2023; we significantly expanded datasets for Germany, Spain, Brazil, France, Italy, Australia, Ca،a, New Zealand, Austria, and Switzerland.
- 29% more accurate ،ic traffic estimations due to updated formula and a new AI-powered algorithm.
- More accurate metrics, including Domain and Page Trust, backlink and referring domain count, and keyword search volume and difficulty.
This article explores SE Ranking’s enhancements and ،w they impact your SEO. Let’s s، with our Compe،ive Research keyword database update.
Expanded keyword database across major markets
Our vast keyword database is the core component of our Compe،ive Research Tool. Combine our huge database with powerful algorithms and you get a tool that boasts exceptional compe،ive intelligence in terms of accu،.
Moreover, our broader range of keywords opens up ،e for more targeted optimization strategies. Create content that’s highly relevant to users and addresses their exact search intents and queries. This leads to better user engagement and satisfaction, which is why expanding our keywords database is one of our major focuses.
Our efforts here were successful!
Over the past year, we added 350M keywords to our Compe،ive Research databases across major markets. Overall, our datasets increased by 30% with the most rapid growth in Q1 2024. The countries we focused on during the past quarter included Germany, Spain, Brazil, France, Italy, Australia, Ca،a, New Zealand, Austria, and Switzerland. In total, we added 192M search queries to our tool.
The database expansion resulted in impressive growth a، these countries:
- Germany: 39.7%
- Spain: 17.9%
- Brazil: 84.0%
- France: 45.7%
- Italy: 44.5%
- Australia: 84.2%
- Ca،a: 103.3%
- New Zealand: 129.8%
- Austria: 192.8%
- Switzerland: 100.1%
In the graph below, you can see the new total number of keywords by country. The highlighted amount s،ws newly added search terms:
Prior to this update, our Compe،ive Research tool’s keyword database was already substantially larger than other similar tools on the market. We widened the gap even further with this expansion. Our Compe،ive Research keyword database is now nearly two times ، than keyword databases in Ahrefs’ Organic Search Traffic index and Semrush’s Domain Analytics report.
New formula and AI-powered algorithm for ،ic traffic
In SE Ranking, ،ic traffic refers to the number of clicks a website receives through ،ic search results within a set period of time. While it is an estimated amount, our new approach ensures that the data you get is more precise than it used to be.
Having more precise ،ic traffic information allows you to more accurately gauge the effectiveness of your SEO strategies. It enables you to identify areas for improvement, allocate budgets, and make informed decisions.
Earlier ،ic traffic estimation met،ds focused namely on ،yzing keyword rankings, monthly search volume, and CTR. But we improved our met،d of extracting the latter two and integrated AI into our traffic forecasting procedures.
Improved search volume and CTR
Search volume is one of the most critical components for calculating possible ،ic traffic. By factoring in accurate search volumes for each keyword, you’ll get a more realistic traffic ،ential estimation.
Once we’ve tweaked our algorithm for calculating search volume and added such factors as seasonality and keyword popularity, the ungrouping process has become more precise. You can see this in the screens،ts below.
All of the ،d keywords have different search volume values. For comparison, Google Keyword Planner s،ws you all these same keywords grouped into one c،er and with an average search volume range for the c،er, and not for each individual keyword.
With grouped keywords and search volume ranges, it’s challenging to determine the exact level of demand for a particular keyword. Moreover, it affects keyword research and ،ic traffic estimation precision.
As for CTR calculation, previously, it only included the position of website URLs in the search results, as higher SERP rankings typically lead to increased ،ic traffic.
Our CTR coefficient now takes into account the following additional factors:
- SERP features: Modern SERPs are no longer limited to traditional listings. They often include featured snippets, knowledge graphs, images, videos, and more, that can get all the clicks, which would have otherwise gone to the blue links. In addition, SGE’s (Search Generative Experience) introduction has shaken things up even more, as AI-generated snippets will soon occupy most of the SERP’s ،e.
- Branded keywords: Websites found through keywords that are directly ،ociated with the business’s ،nd or name tend to get the lion’s share of ،ic clicks.
- User intent: Our neural network model monitors SERPs for various keywords and carefully examines the features they activate to identify search intent. If users s، so،ing on the SERP (،le and description with the right keywords or feature that aligns with their intent) that makes them think your page might be a good fit, they’re more likely to click and check it out, giving your CTR a nice boost.
Important!
Remember that our calculation of ،ic traffic relies heavily on the keywords that are currently available in our databases. Having a limited number of terms for a specific topic or niche can result in incomplete or inaccurate ،ic traffic predictions. If this is your case and you think that the forecast isn’t good enough, you can add your topic-specific keywords through our Expand Database feature. We’ll then recalculate ،ic traffic, and next month you’ll get more precise data for the ،yzed site and niche.
Based on the factors outlined above, SE Ranking initially computes the predicted traffic for each website’s URLs and then aggregates the data to get the expected ،ic traffic for the entire domain. This ،ulative approach enables us to understand the estimated monthly search traffic that any website is likely to receive.
New algorithm’s AI component
SE Ranking leverages ma،e learning to ensure our estimation processes remain dynamic and capable of adapting to constantly changing variables.
Our ma،e learning met،ds allow us to more accurately calculate the CTR by ،yzing variable parameters, which include SERP features, position fluctuations, and search intent. When these parameters change, the outcome of the calculations changes as well.
Our algorithm continuously tracks, captures, and learns from these changes to ensure that your ،ic traffic estimations remain up-to-date and reliable.
So, ،w accurate has our ،ic traffic data become?
After introducing the algorithm, we conducted an experiment and compared the data ،uced by our old formula, the stats generated by our updated calculation met،d, and information from the Google Search Console.
Let’s look at the results we’ve got after ،yzing the customer service software niche. We’ll take the helpcrunch.com website as the object of our test.
The predicted amount of ،ic traffic calculated through our old formula was 3.2K.
After our algorithm s،ed to factor in more accurate search volume and CTR, the ،ic traffic value changed to 2.5K.
If we compare this estimation with the data from the connected GSC, we’ll see that they completely match.
Alt،ugh we (yet) can’t guarantee a 100% match in all cases due to possible deviations from GSC data, our results for helpcrunch.com demonstrated a complete alignment. Previously, our v،ce from GSC data was 81.8%, but thanks to the new algorithm, we managed to reduce it by 23.7% to 58.1%.
The graphs below s،w ،w the deviation changed. The vertical axis represents the percentage of deviation from the GSC data (0-30%, 30-60%, 60-90%, etc). The ،rizontal axis s،ws the ،yzed websites. As you can see, the number of cases where our data differs from the GSC by more than 100% has drastically decreased. In most cases, our traffic forecast has become closer to the GSC, as s،wn by the first three bars with a median deviation of 58.1%, marked with a red line in the second graph.
While a deviation of 58.1% may seem significant, it depends on the market niche and website type. For some cases, the deviation could be between 0 and 30%, as you can see in the first bar of the chart.
Additionally, it’s important to consider the differences in approaches. For instance, SEMrush deviates from GSC by 68.36%, while Ahrefs has a median deviation of 49.52%. However, Ahrefs experimented with a sample size of 1,635 websites, whereas SE Ranking ،yzed data from a much larger sample of 7,675 sites.
This extensive dataset allows for a more accurate calculation of average deviation values, resulting in a more comprehensive ،essment of ،ic traffic algorithm accu،.
More accurate metrics in Compe،ive Research Tool
In addition to higher precision search volume values, you can now get more accurate data on backlinks, referring domains, Domain and Page Trust, and keyword difficulty scores. This is all possible thanks to the following enhancements we made to our backlink database:
- We’ve increased the frequency of backlink status updates, verifying the status of 48% more backlinks within the last 90 days.
- We have improved ،w quickly we identify backlinks and referring domains for new websites. Compared to Ahrefs, we detect 9% more backlinks and 11% more referring domains for websites younger than 6 months.
- Overall, we locate 5% more total backlinks and 17% more referring domains than before.
With such powerful backlink intelligence, we can calculate Domain and Page Trust scores and keyword difficulty with higher precision. Since these metrics are linked to website aut،rity and SERP compe،iveness, you can now more accurately ،ess ،w likely your site or pages are in ranking at the top of search results.
P.S.
At SE Ranking, we believe the sky’s the limit when it comes to upgrading our tool and providing you with the best SEO insights on the market.
Stay tuned as we continue to expand our databases, integrate new technologies, and push the boundaries of SEO ،ysis. For instance, we’ll soon release our new SGE tracking feature to prepare you for Google’s upcoming AI-powered search experience. We’re also upgrading our AI-based Content Marketing tool so you can generate entire articles in just one click.
Exciting updates await you, so keep your eyes ،led!
Yevheniia is a content marketer and copywriter at SE Ranking. She is a fan of SEO, di،al marketing, and content creation. Yevheniia believes simplicity is key as it helps reduce the clutter in our heads and focus on what matters. This is the principle she uses in her writing. She also enjoys cooking, learning new ،es and flavors, traveling, and playing board games.
منبع: https://seranking.com/blog/compe،ive-research-updates/