javiermaestro

Interesting! Have you considered reaching out to one of those (e.g. Citymapper) and see if they would like to work with you? Either employ you, subcontract you, use you as an API, or whatever! :)

I think it's really cool that you maintain such a service and maybe they can find in you a good partnership!

Another nit, the "abandoned" part is the one that was open sourced a loooong time ago. Since then, it underwent a ton of changes but yeah, it's within Facebook. So, not abandoned at all, but not available outside.

The main issue (as usual in big companies) is the large amount of inter-dependencies with internal systems. Scribe as-is today doesn't make much sense outside Facebook. And yeah, it could be cleaned up, mock the internal services and OSS it. But that's a lot of work, both doing it and maintaining it. And having all those mocks, etc "wouldn't be Scribe as-is either"in terms of how e.g. it scales and so on.

In any case, the storage (LogDevice, https://github.com/facebookarchive/LogDevice) which is a large part of the system was open sourced a while back and... sadly it went again into "not-maintained OSS".

Finally, you can get a similar-ish system working with OSS tools (e.g. fluentd + Kafka) that will also scale quite well and which IMHO can also made to scale to Facebook-size levels. So, the incentive is there, but there are OSS alternatives already available :)

Just a nit, for Facebook, Scuba is not the logging ingestion service. It's Scribe, which Scuba itself uses as the ingestion :)

https://engineering.fb.com/2019/10/07/data-infrastructure/sc...

(I worked in Scribe)

RAMPANT!!?

It's really hard to believe that people still write stuff online without doing some basic searching. But here we are...

Here's a couple links to illustrate how RAMPANT knife crime is in the UK:

[1] For the year ending September 2019, there were 221 homicides involving a knife or sharp instrument recorded by the police. This figure is for England and Wales only and it excludes data from Greater Manchester Police (GMP).

[2] Recorded knife crime rose by 7% from just above 41,000 in the year to June 2018 to just above 44,000 in the year to June 2019, knifepoint rapes, robberies and assaults logged by police continued to rise.

I think it's pretty clear that your "rampant" is off BY A LOT. Knife crime in the UK is definitely not something to dismiss but guns (and gun crime and gun accidents) in the US tromp pretty much every other crime statistic in the "modern, civilized" world.

[1] https://www.ons.gov.uk/aboutus/transparencyandgovernance/fre...

[2] https://en.wikipedia.org/wiki/Crime_statistics_in_the_United...

Thanks! I just can't wrap my head around the fact that someone is willing to pay $5 a month for a meme app! XD

Are the users active? Have you thought / analyzed if they pay and forget that it's a subscription? :-?

From your comments, you turned from a one-time purchase to subscriptions.

Can you share your attrition rate? Also, how many want to pay per-month VS the full year (heavily discounted price)?

Thanks!

Mmmm, not sure if that would be the case / possible with something like "First home for your use, you get tax exemptions, etc. Second house, for you, X amount of taxes. If rented, Y% of the income. Third house rented, insane % of the income (like 50%)". That would discourage people from buying-to-rent massive amounts of properties, as they would simply not be cost-effective, regardless of how much you want to pass on to the renters.

If you think that would raise rents by a huge %, I don't think so, as it would be completely impossible for people to pay.

Yup! paper covers / paper bedding, and the expert handling of midwives. Pretty simple and straight-forward!

P.S. also enemas were used in the past... but fortunately, interventions such as this, or pubic hair shaving are no longer ordered for women during labor and birth!

I'm not following. I understood from your first comment that you think the amount of data is low ("underwhelming") and from your last comment that it's a lot ("that much data").

In any case, the data is "whatever needs to be logged".

And it's not "server logs", which is what I'm interpreting from your comment. Scribe transports most data at Facebook to be processed by real-time systems (e.g. Puma, Scuba) and also "batch systems" (data warehouse). So, it's quite a lot, being "the ingestion pipe" for Facebook.

Does this answer your question? :-?

Puma: https://research.fb.com/publications/realtime-data-processin...

Scuba: https://research.fb.com/publications/scuba-diving-into-data-...

Mmm it's not only "telemetry data". It's that (e.g. Scuba) and other types of logs, and not only Facebook (e.g. Instagram as well).

Basically, everything that needs logging and post-processing by both real-time systems (e.g. Puma) and batch processing (e.g. all of the data that's ingested and sent to the data warehouse) goes through Scribe.

(disclaimer: I work in Scribe)

Scuba: https://research.fb.com/publications/scuba-diving-into-data-...

Puma: https://research.fb.com/publications/realtime-data-processin...

The number in the article is 2.5 TB/s, not GB/s :)

(disclaimer: I work in Scribe)

Interesting! Just found out about this, and I googled it out. TIBCO acquired Scribe Software, and Scribe Software was running as early as 1998-1999! :D

https://web.archive.org/web/20120301000000*/http://www.scrib...

The initial stuff seems to not be so related, but the current description of what they do seems much much closer to what Facebook's Scribe does today :)

Naming is hard! :D

The version that was open-sourced kept evolving and integrating with other internal systems at Facebook. That's what made it hard to continue open-sourcing it (why the open-sourced version was discontinued) and why the current version is also hard to open-source.

Maybe one day we'll have a version available. In any case, one of the larger parts of the system (LogDevice) is open source :)

(disclaimer: I work in Scribe)

LogDevice: https://engineering.fb.com/core-data/open-sourcing-logdevice...

That's actually not the case, there's access control :)

The article just focuses on certain areas of the system and doesn't go into the security and privacy parts, that's all.

(I work in Scribe)

As others have pointed out in another HN discussion (1), Mongodb's reply is definitely questionable, if only by its tone.

I already replied to metheus on Twitter (2) in a thread where we asked for a way to repro their claims. I found their reply and comments very inappropriate, similar to the comment in here. Arrogant and derogatory to OnGres.

Anyway, I was writing this to note that OnGres has replied to Mongo's reply setting an example of how tech discussions should happen: without derogatory and arrogant comments, open to valid criticism (i.e. with something more than words and numbers that cannot be reproduced) and transparency.

Check it out: https://ongres.com/blog/benchmarking-do-it-with-transparency...

In there you'll see how Mongo consistently mis-interpreted (or mis-represented?) the results. They kept mixing the benchmarks and constantly talked about an experimental driver and missing connection pooling. In fact, they did use the official Mongo Lua driver and the official Java driver for different benchmarks and they did some of the benchmarks with and without connection pooling and published both results.

It's really sad to see Mongo reply to a thorough benchmark like this. It probably has its flaws but instead of correcting them or publishing a better benchmark like the one they did (to magically get 240x...) they chose to mischaracterize the work of others, spreading FUD and accusing them of cheating and being dishonest.

Hopefully they'll turn around and fix it. All it takes is to publish how they got they amazing numbers so that others can comment, repro or dispute the benchmark.

(1) https://news.ycombinator.com/item?id=20479670

(2) https://twitter.com/javiermaestro/status/1151849279226556417

Mmmm maybe I'm missing something, but... what's preventing the rest of the command from being corrupt? Imagine two commands, CM and DM. CM is good and DM is bad. Noise gets in and changes ATCM into ATDM. Boom.

Unless you have error detection / correction, etc, I don't think the AT would add anything else to the equation :-?

A few things. First, can't you run Linux inside a Solaris Zone? I don't know much about Solaris stuff (although I do like it very much, I grew up mostly with Linux, which you so much despise, and I'm not too familiar with other Unixes). So... I think you could probably run Logdevice if you really wanted.

Then, here's my two cents. When engaging in conversation and civil dialog, please try to avoid being so dismissive and so proud of yourself and of how much you think you know about stuff. You come across as abrasive and entitled. It's not nice to just jump into a conversation and talk trash about the work of others just because you dislike the operating system that they use.

Finally, if you really care, work on porting it to your operating system of choice and engage in civil conversation doing pull requests, etc. Everybody will be thankful for that.

Awesome to see this finally happening :)

Previous discussion in HN: https://news.ycombinator.com/item?id=15142266

Please do, because I'm interested in seeing how non-relational it is... I truly believe it has to be otherwise, so I'd love to read your findings!

Since quite a few people have been commenting without even googling some data, here we go:

https://www.bre.co.uk/filelibrary/pdf/rpts/countryfactfile20...

Page 3, Summary:

Around 83% of homes in each country have some double glazing. Northern Ireland has a higher percentage of homes which are fully double glazed, 62%, compared with 32-44% in the other countries.

So, ~60% of the houses are NOT fully double-glazed. In 2007. Srsly. And sure, it's from 2007... but in my expericence, and in talking with a lot of friends, in a main city such as London and in other small cities (e.g. Fareham in the south), the situation is quite similar nowadays...

Really? Check this: https://www.bre.co.uk/filelibrary/pdf/rpts/countryfactfile20...

Page 3, Summary:

Around 83% of homes in each country have some double glazing. Northern Ireland has a higher percentage of homes which are fully double glazed, 62%, compared with 32-44% in the other countries.

So, ~60% of the houses are NOT fully double-glazed. In 2007. Srsly. And sure, it's from 2007... but I highly doubt the situation has changed...

LOL please go look at a map of London, Z1-Z2. Protection? It's almost like every other building is "protected"!

Plus, read my comments. I'm saying the government should take care and sponsor the fixes to ensure the quality while greatly reducing the energy bill (that's my thesis).

Sure, it's annecdata... but just come to London. All of the old housing from the 70s or before (most of Z1-Z2) is single pane. Also, go search in Zoopla for double-glazing... landlords mark it as an extra for a reason (unless it's a new development, in which case it will be double glazing).

Well, I've talked to people and been to quite a few places in the UK, Scotland, etc. I know many people living in London, the UK and Scotland. We all agree. I'm pretty sure it's the same all over the UK

And for the rental prices that you pay here, it's pretty shameful the state of the houses, windows included.

So then, we all agree that the old (ancient) and unmaintained wood frames in the UK are crap. Cool! :) Really, I couldn't care less if they replaced the frames with wood or whatever, as long as they made sure that they were thermally good and avoid wasting all of the heat...

So then, we all agree that the old (ancient) and unmaintained wood frames in the UK are crap. Cool! :)

Really, I couldn't care less if they replaced the frames with wood or whatever, as long as they made sure that they were thermally good and avoid wasting all of the heat...

So that's what I'm saying. Instead of useless laws like that one, the Government should put a lot of weight and money and refurbish all of those windows, making them modern while using all those "original materials" or whatever they want.

Instead, I'm sure half the energy footprint goes to waste through those windows...

Can't understand your comment. You are agreeing with me that, in most other parts of the world, double-glazing (aka a glass that won't break if you elbow it by mistake!) is the norm. But in the UK, it's sadly the opposite. So we agree that they should replace their crappy windows with double-glazed, properly insulated, ones...

I agree most buildings won't be listed and most landlords are cheapskates. But there are quite a lot of listed buildings in London:

http://londonist.com/2011/06/all-listed-buildings-in-london-...

Nothing against wood, really. But if you've been to the UK, you should agree that the unmaintained, not-properly-fitted, wooden frames that they use in most old windows are just crap. They let in huge amounts of wind, cold, etc, through the unsealed seams. Anything that improved that would be 10 times better, regardless of the yellowing, etc.

I'd love to see the results... I've never been so baffled in my life, looking for a "normal" flat in London and looking at horrible prospects that cost a fortune with windows from a century ago. And when I asked about that, they were all saying "oh, but the house is listed! Can't change the windows unless X, Y, Z". Whatever.

We can put people in a rocket and take them to the moon but we can't replace windows and make them look identical to the previous ones but with all of the modern efficiency. Because oh well, the building won't be looking exactly like two centuries ago or something.

Completely crazy, let me tell you... :(