西部数码 Access Statistics and Traffic Explanation (Keywords: Access Statistics, Total Traffic, Statistical Software, robots.txt, Spider, Traffic)

I. Why is the monthly traffic figure in the hosting control panel much larger than the sum of the daily traffic of the month in the website access statistics? Answer: Please verify from the following three aspects: 1. Monthly traffic is the total traffic of the main site + sub-sites. If sub-sites have been created under your virtual hosting, please note to include the sub-sites' traffic as well; 2. In access statistics: browser traffic and non-browser traffic need to be added together; non-browser traffic is generally caused by mp3 etc. being downloaded by software such as Xunlei or read by search engine spiders. 3. Some models of hosting use CDN technology, such as cluster hosting, Hong Kong/Taiwan hosting, dual-line hosting, virtual hosting with a dedicated IP purchased, etc. The traffic of the part using CDN technology will not be reflected in access statistics. The control panel generally displays corresponding information, e.g.: Total traffic: 15G Used: 2.0G (of which 1G is carried by CDN) II. Why is there a big difference between the backend access statistics and other statistics software (such as cnzz, etc.)? Answer: Our statistical software analyzes and records the entire website access log, that is, all accessed web page files, image files, CSS files, etc. are all recorded and counted; while other third-party statistics (such as cnzz) are often based on inserting statistical code into web pages, and traffic of files without statistical code cannot be counted by third-party statistics. For example, if a 100M rar archive is downloaded by Xunlei 100 times, cnzz etc. cannot count it. Therefore, there are differences between the two statistical results, and some results are very large. III. Why are the backend traffic and the traffic in access statistics inconsistent? Answer: Under normal circumstances, after a user purchases our virtual hosting, the traffic usage displayed upon logging into the management center is consistent with the traffic displayed in the “Access Statistics” function. However, when the user uses our CDN technology (West.cn dual-line, multi-line, Hong Kong/Taiwan hosting) or purchases cluster hosting, there may be a considerable gap between the two, and the backend traffic will be much larger than the traffic displayed in “Access Statistics”. The reason for this situation is that our CDN technology realizes the separation of access and data center. Most user visits will be directed to CDN nodes rather than data center servers. Only files that cannot be cached (such as ASP/PHP programs) will be directly obtained from the original data center, while images/flash/css etc. are directly obtained on CDN nodes. The “Traffic Statistics” displayed in our backend includes traffic on all CDN nodes, while “Access Statistics” only counts traffic generated by the data center. Because most visits will be cached by CDN, there will be a large gap between the two statistical results, that is, “Backend Traffic Statistics” will definitely be greater than the traffic displayed by “Access Statistics”. IV. How to prohibit search engine spider access (robots.txt)? Answer: Create a robots.txt (lowercase) file in the root directory, and use this file to prohibit search engine spiders from accessing. Specific method: For example, to prohibit Baidu spider access: User-agent: * Disallow: User-agent: baiduspider Disallow: / First is User-agent. Each search engine has its own User-agent, e.g., Google's is Googlebot, Baidu's is baiduspider; it may be case-sensitive, and for others you should check the corresponding help page of the search engine. * is a wildcard matching all search engines, and the Disallow: item indicates the location to prohibit access. The first Disallow: is empty, indicating there are no prohibited access items, that is, all search engines are allowed to index. However, if you want to add an exception, you can also add a line User-agent: baiduspider, indicating that the following rule only applies to Baidu spider. Baidu spider's rule is Disallow: /, which means prohibiting indexing of all web pages under the domain. Special note: Generally, it is not recommended to prohibit search engine spider access. After prohibiting spider access, your website may be removed from Baidu etc.'s index, which will cause your website traffic to decrease and lose potential customers. For more detailed introduction, please visit: http://www.west.cn/faq/list.asp?unid=626 Method to intercept spider access using pseudo-static rules: http://www.west.cn/faq/list.asp?unid=662 V. Why is my site's traffic so high? Answer: High website traffic means your website has a large number of visits and is popular with customers. If there is abnormal traffic, please check “Access Statistics” and “Traffic Analysis” in the control panel, compare how large the daily IP and page views are and whether they are normal; whether there is a large number of visits to file categories, url addresses; whether the non-browser traffic value is large, and if so, check whether hotlinking has occurred or files are being directly downloaded; whether the traffic used by search engine website robots is abnormal; check whether files such as MP3, rar, zip etc. on the website are being accessed in large quantities. VI. Is there a way to save traffic? Answer: Because bandwidth costs in Hong Kong data centers are very high, the traffic that can be purchased at the same price is much less than that in domestic data centers. It is recommended that users using Hong Kong/Taiwan hosting complete ICP filing as soon as possible and migrate to domestic data centers. Domestic data centers have sufficient traffic and are cheaper. In addition, you can consider upgrading to VPS or cloud hosting (unlimited traffic). VII. If a website is subjected to CC attacks, does attack traffic also count? Answer: The system calculates traffic based on access logs. Whether it is normal access, attacks, or search engine spider access, traffic is counted. Our company has been established 13 years ago and has cumulatively served more than 300,000 websites. The traffic of all websites is based on access logs. Traffic is calculated through our self-developed software and displayed in “Traffic Statistics”; at the same time, we use the log analysis software of the foreign third-party software company awstats and display it in “Access Statistics”. We also provide the original logs of websites for customers to download and analyze by themselves. The logs and traffic of all websites are transparent.