Hi @certik , I am not able to identify a reason for bing not crawling , I have checked with the lighthouse as well as we also added the cannonical links and also added redirects to the new webpage. I would be grateful and happy to patch if anyone could please help identify the underlying issue. ( the site is being very well indexed by Google , Ranking #1 in India when searched for “fortran language” , I am unable to identify the cause for the bing crawlers not crawling the website.)
I think we have not created a ticket at Microsoft, and maybe few other things we still didn’t do. Let’s get them done all. We are not the only ones with this problem, I found others, such as:
There are a lot more, I remember recently reading about some website, but can’t find it now. Well, probably using DuckDuckGo to search for why something isn’t included there doesn’t help, as they might be in a slight conflict of interest.
Anyway, let’s do all of the above items, and if Microsoft doesn’t respond, let’s write a blog post with all the details what we did and timeline and let’s use our contacts in Microsoft and publicize on Twitter, Hacker News and other outlets to try to get this resolved. Any other ideas?
Why don’t we unpublish the old site? It’s one thing that seems quite relevant here and that we haven’t tried. If you have any objections, please write here, otherwise I’ll unpublish the site on Monday morning.
@milancurcic go ahead and unpublish the old site. (I thought we already did that.)
After that, if this doesn’t get fixed in a week or so, let’s create the ticket, which @awvwgk can take a lead on.
Regarding the market share of search engines, I would be careful. I know that Google has pretty much 100% (the link above says over 93%), but I would not be surprised at all if it is like with Windows / Linux. Windows used to have close to 100%, but Linux was close to 100% on servers and HPC clusters, etc. So if something didn’t work on Linux, that was a real deal breaker, even if in a general statistics Linux was rounded to 0%. The statistics that we care about is developers and potential users of Fortran that maybe do not use Fortran yet.
I had already noticed something weird in Bing (fr). I don’t find fortran-lang.org in the first six pages. This is the top of the 6th page (everything normal here):
Interesting, if I do the same with C++, I can notice a difference in that final page: for C++ the interface is in French, for Fortran it is in English.
Very strange behavior… And does Microsoft is conscious that it uses the Facebook logo?
In the French Qwant, the situation is even a little worse. The 27th January, I posted “I can see on page 2 Learn — Fortran Programming Language” (the only page of the new site that was in the results). But it has now disappeared. In Qwant, the situation is just saved by a Wikipedia frame at the top right, which displays the URL of the new site.
But today, looking at its strange behavior more attentively, I don’t know what to think. I hoped that our new site would go up like a bubble, but as this page is a kind of redirection, I fear it will not happen. The only positive thing is that it shows that Fortran-lang.org is still in Bing database. But if it is blacklisted in the normal results pages, what’s the use?