HNHacker News
TopNewBestAskShowJobs

BiasRegularizer

200 karma · joined May 13, 2019

PhD student in Machine Learning, primarily focused on multimodal representation learning, contrastive learning, and robotic applications
submissionscomments
BiasRegularizer··on How is AI impacting science?
Although the article focused primarily on AlphaFold, many other ML approaches are making impactful contributions in the general scientific field. One example is the diffusion model and its use of stochastic differential equations (SDEs).

Microsoft has an initiative called AI4Sciencie (https://www.microsoft.com/en-us/research/lab/microsoft-resea...) which published a fair amount of SDE/diffusion-based method to solve scientific problems

BiasRegularizer··on Females less likely to heal from ACL injuries than males in animal model
I personally dislike these kinds of comments. The idea that androgens aid in recovery may be known in theory, but this study provides empirical evidence to support that claim. So yes, there is scientific value in it.
BiasRegularizer··on 2023 Nobel Prize in economics awarded to Claudia Goldin
What aspects of the economic studies makes it a pseudoscience? Highly empirical, sure, but so does modern machine learning.
BiasRegularizer··on Temporal quality degradation in AI models
Distribution shift in the real world data will always be inherent to any data driven methods. Unless there are major advances in continual learning for DL models, they will always struggle with distribution shift degradation.

Similarly, humans are also prone to the distribution shift unless we get updated information on a specific topic. The key differences are that we are great at continual learning and we are much better at learning abstraction

BiasRegularizer··on An introduction to zero-knowledge machine learning
A 17 million parameter model (~Resnet50) takes more than 50s proof time. Is this on top of the inference time?

I can see some niche applications for this system, but I am very skeptical it's ability to handle larger models (100M+) and the ability to and it's scalability when there are increased demand.

BiasRegularizer··on GPT-4 Is a Reasoning Engine
It's not impossible to see that LLMs can make finite step "reasoning" between input and output, as each block of the transformer can model probabilistic causality. Transformers are sometimes considered a fully connected graph neural network, which can be used for modeling causal graphs. One additional supporting evidence on the finite step reasoning hypothesis is that "train of thought" improves the performance of LLMs[1], meaning that letting the model explain itself explicitly reduces the amount of implicit "reasoning" steps that need to happen within the model.

Additionally, while we don't know how us humans functionally reason, it's believed that the predictive nature of our brain is central to our reasoning abilities. Maybe in some way, the autoregressive nature of LLMs is similar to our predictive brain.

For a collection of emergent properties in LLMs, I recommend this paper [2]

[1]https://arxiv.org/abs/2201.11903.pdf [2]https://arxiv.org/pdf/2206.07682.pdf

BiasRegularizer··on NightWare helps disrupt nightmares for those with PTSD
Apple Watch has so many health features, but the main hinderance for me is its relatively short battery life - I often forget to put it back on after charging it.

Has anyone tried having two apple watches so one can be worn while the other charges?

[edit] Charging it at night is kind of missing the point, as I would like to track both my daily activities and my sleep

BiasRegularizer··on Decompiled 2022 Beijing Olympics Apps
VPN might have a part in this too. I remember when I was in China, I was connected to ExpressVPN 24/7 (whatsapp, gmail etc), and the battery drain was visibly higher than when I had the VPN off.
BiasRegularizer··on Starlink is now Accepting General Pre-orders
While this may be amongst the long term goals, I don't think it's useful for military applications yet until laser com is fully online. Currently there is no sat to sat com, so there's is always ground station within sight of a sat. Unless SpaceX places a ground station near a conflict zone, military can't utilize it much yet.
BiasRegularizer··on Winklevoss 500k Bitcoin Argument
You didn't quite get the point. As individual currencies governments exert a lot of power over their relative value to other currencies. As a whole, worlds fiat currencies hold no intrinsic value. No government can dictate that a kilogram of gold to only cost $1.
BiasRegularizer··on Winklevoss 500k Bitcoin Argument
I suggest you look into modern economic theories and why inflation is crucial to economic development. There are two problematic assumptions in your statement:

1. Nobody would store all their wealth in a deflationary currency - other forms of assets, stocks etc will still exist. They will need a high liquidity vehicle to trade a.k.a inflationary currency.

2. Deflationary currency doesn't necessarily mean it will gain value overtime. Unless it contains growing intrinsic value, the overall market cap will drop/plateau.

Think of inflation vs deflation as lubricant vs sandpaper, one encourages economic activities while the other discourages.

BiasRegularizer··on Winklevoss 500k Bitcoin Argument
Yes, but one would prefer spending money using an inflationary currency since holding on to it devalues over time. As long as inflationary currencies exist, people will prefer to spending those first before deflationary currencies.
BiasRegularizer··on Winklevoss 500k Bitcoin Argument
I believe this applies to all currencies - they don't have intrinsic values. The values are derived from the market. Be it USD, BTC, EUR, or the Zimbabwean dollar. However, the purpose of currency exists as a vehicle for wealth transfer.

IMO the biggest problem with most cryptocurrencies is their deflationary nature. Limited supply means they behave more like assets than currency. As currency nobody would want to spend it as they gain value over time. As an asset it lacks intrinsic value, and therefore overall market cap will tank slowly.

BiasRegularizer··on Spinning Up in Deep RL
I believe he's referring to the absurdity of this statement, especially in relation to SpinningUp (it doesn't have any UI as it's a RL library, and the docs site are generated using standard Sphinx doc generator)
BiasRegularizer··on Introducing Instagram Reels
I personally like the name Reels, it implies a level curation needed in the process.
BiasRegularizer··on Ryzen Threadripper Pro 3995WX Spotted
Also, GPU has VERY limited memory and no virtual memory.
BiasRegularizer··on Play Counter-Strike 1.6 in your browser
FYI the creators are actually charging $2/week subscription for this game. Profiting from a cracked software definitely crosses some moral boundaries.
BiasRegularizer··on NASA, SpaceX set May 27 as target date for first crew launch
Another loss for Boeing on top of the 737MAX debacle and Covid-19. I would hate to be their CEO right now.
BiasRegularizer··on U.S. airlines want a $50B bailout. They spent $45B buying back their stock
Almost all major airlines in the world are receiving government bailouts: France, Germany, UK, Japan, Sweden, HongKong, UAE, Singapore. The airline industry is a notoriously cut-throat industry with lots of protectionism from nations, one can't just expect US airlines to sit on $50B cash and not put it to work.
BiasRegularizer··on U.S. airlines want a $50B bailout. They spent $45B buying back their stock
Why not loans? Pandemic is not the fault of the airlines, just like small businesses around the world, most airlines just need a short term loan to resolve liquidity issues while the pandemic blows over. Loans are safer investments than buying stocks.
BiasRegularizer··on Chinese scientists destroyed proof of virus in December?
One can argue modern definition of racism has expanded much beyond race. Though I also didn't want to start a pedantic argument on the definition of racism with the original OP. Rather to point out how distastefully the Chinese Gov have acted in response to Trump and Pompeo.
BiasRegularizer··on Chinese scientists destroyed proof of virus in December?
Both are very classic traits of authoritarian gov: In times of crisis, it's far more efficient than democratic governments. However, in times of non-crisis, its centralized power and information control would cause a crisis that would've been otherwise avoided.
BiasRegularizer··on Chinese scientists destroyed proof of virus in December?
One of the headline news from a couple of days ago, voicing support for Foreign Ministry Spokesperson's conspiracy rant on twitter. It's bizarre and make Chinese Gov look extremely childish.

https://new.qq.com/omn/20200313/20200313A06PZU00.html

BiasRegularizer··on Chinese scientists destroyed proof of virus in December?
So the Chinese Gov thought the proper way to respond to racism is to fuel misinformation and conspiracy theory?
BiasRegularizer··on China Sacrifices a Province to Save the World From Coronavirus
Here's the actual news from Jan 1 reporting on the 8 "rumor spreaders". They kept emphasizing that there was no evidence of human-to-human transmission. It's pathetic to look at now. (sorry the article is in Chinese)

https://www.guancha.cn/politics/2020_01_01_530191.shtml?s=zw...

BiasRegularizer··on China Sacrifices a Province to Save the World From Coronavirus
Here is the news from Jan 1 in Chinese.

https://www.guancha.cn/politics/2020_01_01_530191.shtml?s=zw...

BiasRegularizer··on China Sacrifices a Province to Save the World From Coronavirus
I mean, if one is being reckless with fire and accidentally burned their own house down, but they managed to put it out before spreading to the neighbors. Can people really hail that person as a hero?
BiasRegularizer··on China Sacrifices a Province to Save the World From Coronavirus
Mistakes can happen but wittingly suppressing news is not accidental nor a mistake.

I was born in Wuhan and half of my family are currently holed up there. A few days before the Wuhan lockdown was ordered, coronavirus already made it to the headline in CNN and NYT, but there was not any headline news about the coronavirus within China. Heck my dad wasn't even wearing a mask on his 1hr metro commute to work until the day before lockdown happened.

In early January, government officials and news outlets were reporting: "There are false rumors about Wuhan having a SARS like virus. This is an unknown virus that's _probably not_ transmittable from human to human. There are only 45 confirmed cases. There is no need to panic. "

One of the officials even organized a thousand people CNY dinner as part of the CNY celebration a few days before the lockdown.

They had a thousand opportunities to curb the disease and alert the people, but the Chinese bureaucracy and leadership's imcompetence directly caused the coronavirus disaster.

Edit: January 21 news article on the thousand people dinner from a Chinese source. About 40k people participated, this neighbourhood is about 10 minutes away from the epicenter: https://news.163.com/20/0121/15/F3E3UTKI0001899N.html

BiasRegularizer··on Coronavirus Real Time Map
Baidu's realtime map has a higher count this, though in Chinese. It seems to be more up to date, with detailed patient info sometimes included in the news tab.

https://voice.baidu.com/act/newpneumonia/newpneumonia

BiasRegularizer··on China building 1k-bed hospital over the weekend to treat coronavirus
I meant the brand, not the quantity. Sorry!
Page 1 of 2Next →