Does each airline have their own way of exporting this data? Is there a single entity that aggregates from all of them? How does the actual data look like? (Is it a dump every X hours, or something more modern like a stream you can subscribe to?).
The GDS companies get this data from these sources and then in turn provide (crappy) APIs for customers to use to query it.
In general, if you're doing bookings you can get small amounts of the data (a query at a time) from a GDS. Otherwise you're looking at millions of dollars per year. And then you need to write code to parse it and price tickets using it (approximately 1M LoC if you're terse about it -- more like 30M if you're a GDS).
(I know all this because I co-founded ITA Software, whose software now powers Google Flights.)
Honest question (I swear I'm not trying to troll): what do you actually do with it that you can't do (or do as well as) with Google Flights or Kayak or some other site like that?
I ask because I've used ITA Matrix and never managed to find a cheaper flight than I can through "normal" means... but I rarely fly multi-destination (and basically never do more complicated stuff) so I'm not sure if the use case is beyond mine or if I just don't know how to utilize it in a useful manner.
If you're only looking at flights out of a particular airport and with a specific (default) routing, you'll probably not find anything better.
If you know that certain airports are hubs, or that a particular carrier has a slightly longer route that takes you via a certain city and maybe have a longer layover then you might be able to find some really good deals.
Being in Australia, I really don't get to take advantage of these things at all.
- Multiple departure/destination airports (you can search SFO,SJC,OAK to LGB,LAX,SNA and back in a single search). To be fair Google supports this on desktop too (but doesn't on mobile).
- Better search for return flights with variable stay lengths (Google only does a 5x5 matrix, ITA Matrix does a full month).
However, perhaps the biggest downside is that you can't actually book through ITA Matrix. It only finds the fare, you have to find it elsewhere to actually buy it (although Hipmunk takes routing codes, which makes it easier)
E: 25% Mileage
L, U, T, X, V: 50% Mileage
H, Q, K: 75%
B, M, S: 100% Mileage
Y: 125% Mileage
If you search on Google Flights, these will all be called "Economy". If you search on most of the other OTA's, you can sometimes find the fare class during checkout or even as part of your search results, but you can't filter on it (Hipmunk is one that does support some of ITA's syntax for these filters, but not all). The buckets aren't always strictly more/less expensive, but they're usually not exposed very easily, if at all[2]. So, you're often left crawling from listing to listing, expanding to see if they are going to get you any miles. (I'll save the debate of whether miles are worth all the effort for another day.)
On ITA, it's not unreasonable to construct a query that says "During the month of November, show me round trips that are between 12 and 19 days that are going from Denver to either Narita or Haneda Airports, which will earn me more than 50% miles on either Delta or American or JAL, but also only ones that connect in Portland or Los Angeles, with no prop planes or overnight stops, and no <50 minute connections or 3+ hour connections". (I wouldn't actually specify all of these stipulations, but they're good for the example! :) )
[1] https://www.alaskaair.com/content/mileage-plan/how-to-earn-m...
[2] Delta, to its credit, does allow you to search by minimum fair class on its advanced search)
2. As recently revealed by the company http://www.flyertalk.com/forum/27265924-post483.html you can avoid connections in certain countries which can be beneficial for visa purposes or certain personal privacy requirements ( I know a German physics professor who refuses to go to the US because of the fingerprinting. )
How did you go from games to developing airlines reservation and fares software?
As for the GDSes, their code is primarily TPF assembly. So now add the LoC blow-up of using a very low-level language.
There are like 25 people in the world who understand this stuff, and half of them likely work at ITA/Google.
As to the "categories", people at Sabre working with them used to say in some cases you can not even be sure if the calculation (of a ticket price - "fare") will end in finite time, so the "macro language" is apparently Turing-complete!
I've written elsewhere that I personally think the original Sabre system was/is one of the most impressive accomplishments in the history of computing. Using modern tools made things easier for us at ITA, though we compensated for that by trying to compute the entire (very large) solution space for every query, where prior systems used heuristics.
https://en.wikipedia.org/wiki/Global_Distribution_System
Downstream companies then query this data and show them to you. The competition comes from the complex caching and delivery mechanisms that the companies use to get you the best price.
It's not really an area that is ripe for disruption. The margins are extremely low and there are only really two companies that make a majority of the money. Expedia and the Priceline group.
I know that for airlines like easyjet you need to visit their website to get fares though. (Or Google would have to build a site crawler)
I work with a lot of smaller airlines, and from my experience I can tell you no. Many of them can't even tell you their actual route list or flight schedule or pricing logic. They typically buy a booking engine solution from just a few major players (Sabre, Amadeus, TravelPort) who do have centralized data, but access to them is slow, expensive (at scale) and restrictive.
I've been told by one of the GDS's that our use case doesn't apply for direct GDS access, and we have to go through the airlines' access method. I don't know if these booking engine solutions include access to an API or not, however most airlines have said either they don't have an available API, or don't know how to share access to one.
Some of the larger airlines do seem to have their stuff together. But we're just starting to work with them, and because of all the bureaucracy involved it will likely be months before anything happens.
The screen scraping method djhworld mentions is a worthwhile approach if you'd personally like to track a few routes. I've done the same to watch prices to NYC (I visit friends often) on a few of the low-cost airlines. It's nice because you can tailor the logic to your preferences. Such as don't bother searching flights that don't include a weekend in the trip; or set my alert threshold 25% higher when the trip involves a holiday or long weekend.
For screen scraping, there are a number of companies that do this already for multiple carriers. I'd suggest making use of one of these rather than reinventing the wheel. Example: http://xmldocs.travelfusion.com
About screen scraping, I guess it depends on how quick you are at writing scraping scripts (and if you find it fun). I could probably write one faster than I could register for that API. You're also adding a layer between you and the prices. You don't know how long Travelfusion has cached these prices for, while it's simple to write a script that opens the real booking engine to get correct prices. I typically only run mine when I'm ready to purchase a ticket, but don't know which dates, rather than running it constantly to find deals.
And if I were doing anything more than a few routes on a few carriers, I definitely would use a real API instead of reinventing the wheel. In this case I just think it's kinda fun.
…and then decide if you still want to pursue this.
Wrong example. I have worked on the Southwest Project when I was at Amadeus.
Not sure on the legality of it though.
If an airline sells seats, bags, and other ancillary services, why aren't they trying to find more sales channels, to sell more?
I believe that airlines haven't been pushing for innovation, and rather, have been slowed down by their very own current third party providers, or "core business partners".
Travelling technology applications or reservation systems, first appeared a long time ago [2] and because at that time, they were innovations, some airlines signed up for them, to make more sales by globally or regionally distributing all of their flight related information (seat or ancillary availability, fares, code share agreements, etc.). For this reason, we can consider reservation systems as the very first technological airline business partners.
Typically, the reservation systems provided innovation on a distribution factor, which is the travel agency distribution factor. Travel agencies could, and have been connecting to reservation systems and making purchases that increase the number of airline sales, resulting in a win-win, for both agencies and airlines. [3] Reservation systems have other goals, such as flight code share agreements, but these are out of scope. [5]
Today, these third party business organisations do not want to lose market share, so they make things expensive or maintain the old prices, and open very little doors on the borders of their systems.
Therefore, only typical rich individuals or companies can afford to purchase and maintain the costs of direct connections to these providers, which is a win-loss, win for the reservation systems, and loss for airlines.
Fortunately, companies such as Google (with QPX), perform a re-engineering of what these big reservation systems players do, and make it much more affordable and simple to implement [4], and with that, not only they improve the understanding effort of the whole business, but also, provide more sales leads to the airlines, and better user and developing experiences.
The future should be standardised, airlines should distant themselves from the reservation systems (if these do not innovate), and open the doors of their businesses, by creating booking process APIs, that allow, developers and startups, to create powerful and innovative applications, that bring sales.
[1] https://www.tnooz.com/article/why-is-the-travel-industry-so-... [2] https://en.wikipedia.org/wiki/Sabre_(computer_system) [3] https://en.wikipedia.org/wiki/Travel_agency [4] https://developers.google.com/qpx-express/v1/pricing [5] https://en.wikipedia.org/wiki/Codeshare_agreement