monkmartinez

Serious question, how does one determine vibe coded or not?

"Literally everything" doesn't amount to much if I can't actually control the stupid thing.

That is just one very simple part, connecting the mouse. Literally everything else sucks on iOS. File management, hidden menus, running multiple apps, system management... and the list goes on. Need to convert a STEP file to something else on the iPad? Download 15 apps to see which one works, then try to find the converted file in the abomination of a file system? iOS is hot garbage.

I have been programming as a hobby for almost 20 years. At least for me, there is huge value using LLM's for code. I don't need anyone else's permission, nor anyone else to participate for the LLM's to work for me. You absolutely can not say that about blockchain, nft, or crypto in general.

I have read that thunderbolt and oculink are very different in this regard. Whereas thunderbolt devices can be plugged in at anytime, the oculink needs to be plugged at boot time. This seemingly innocuous detail is the catalyst as to the reason why oculink is better performing. It comes down to PCIe vs Thunderbolt in general.

You mean like fish a cable through the case? It looks like it might be doable based on the pictures. If its in the right spot, you might even be able to 3D print a cable gland or something at the case. Hard to tell based on the pictures.

Read above now and twice on Sunday.

I love the idea of using the tube and measurements as a random number generator! However, please treat the whole category of homemade devices to measure/detect "bad shit" as novelty and nothing else. If you are actually concerned enough to really measure/detect harmful materials, buy the proper devices. Learn how to calibrate and how to use them properly. The last thing our 911 system needs are people calling with aliexpress radiation detectors going off in a cancer center.

L.A.M.E.[1] !!!! 99.9999999999% of the fun is the code.

[1] Lacking Any Major Excitement

This is awesome. The readme is fun as heck and I just want to use the software based on that. I see nothing but complaints about nextcloud and others on r/selfhosted. I can't wait to try this out.

At the risk of dating myself; Unsloth is the Bomb-dot-com!!! I use your models all the time and they just work. Thank you!!! What does llama.cpp normally use if not "jinja" for their templates?

US Centric view:

I would love to open a workspace. Full stop.

However, due to the price of the shredder and the tools required to transform the plastic into new forms; One needs to have a dedicated space with a lot of power. Then you need to secure a source of plastic. You would think this part would be easy, I mean that is the whole premise of this org's existence, right? You would be wrong in that assumption. There is big money in "recycling" in the US. From the collection, sorting, and distribution of recycled materials... someone already has a contract to legally "do it."

I am bummed to see them in this position. There seems to be a few hotspots around the world where this would really work. They aren't near me, that is for sure.

Maybe I am doing something wrong! When I change parameters on the modelfile, the whole thing is copied. You can't just edit the file as far as I know, you have to create another 38GB monster to change num_ctx to a reasonable number.

ollama pull hf.co/unsloth/Qwen3-30B-A3B-GGUF:Q4_K_M and the modelfile comes with it. It may have errors in the template or parameters this way. It has to be converted to GGUF/GGML prior to using it this way. You can, of course, convert and create the specific ollama model from bf16 safetensors as well.

If you ollama pull <model> the modelfile will be downloaded along with the blob. To modify the model permanently, you can copypasta the modelfile into a text editor and then create a new model from the old modelfile with the changes you require/made.

Here is my workflow when using Open WebUI:

1. ollama show qwen3:30b-a3b-q8_0 --modelfile

2. Paste the contents of the modelfile into -> admin -> models -> OpenwebUI and rename qwen3:30b-a3b-q8_0-monkversion-1

3. Change parameters like num_gpu 90 to change layers... etc.

4. Keep | Delete old file

Pay attention to the modelfile, it will show you something like this: # To build a new Modelfile based on this, replace FROM with: # FROM qwen3:30b-a3b-q8_0 and you need to make sure the paths are correct. I store my models on a large nvme drive that isn't default ollama as an example of why that matters.

EDIT TO ADD: The 'modelfile' workflow is a pain in the booty. It's a dogwater pattern and I hate it. Some of these models are 30 to 60GB and copying the entire thing to change one parameter is just dumb.

However, ollama does a lot of things right and it makes it easy to get up and running. VLLM, SGLang, Mistral.rs and even llama.cpp require a lot more work to setup.

I can't tell if this is sarcastic or genuine surprise.

My question is; Why even have a "wallet" at this point?

My teens use these little things that attach to their phones to hold gym key, debit card and ID.

I use a traditional "wallet" or billfold as my abuelo used to call them, but I am positively a dinosaur using one. Also, the darn thing hurts my back if I leave it in my back pocket while driving/sitting.

Heck, I have been eyeing those crossbody bags or saccoche to hold the things that are in my wallet.

Its really not hard to test with llamafile or ollama, especially with smaller 7B models. Just have a go.

There are a bazzillion and one hardware combinations where even RAM timings can make a difference. Offloading a small portion to a GPU can make a HUGE difference. Some engines have been optimized to run on Pascal with CUDA compute below 7.0, and some have tricks for newer gen cards with modern CUDA. Some engines only run on Linux while others are completely x-platform. It is truly the wild-west of combinatorics as they relate to hardware and software. It is bewildering to say the least.

In other words, there is no clear "best" outside of a DGX and Linux software stack. The only way to know anything right now is to test and optimize for what you want to accomplish by running a local llm.

IANAL. I would think fraud needs investigation much deeper than; "This $200 million is being spent on <insert program> that we don't need at the moment."

First you find where the money is being spent and if it doesn't match the goals of the administration, you turn it off. If there is potential for fraud, you mark the case for further evaluation and investigation. The most important first step is always to stop the bleeding and in this case, bleeding money.

You can come back to investigate at a later time. Prosecuting fraud before the bleeding has stopped is a waste of time imo.

Who determines "excess" consumption? Who holds the cards for accountability?

I don't know about you, but I am not capable of critically thinking 24/7. Do you critically think, like always?

We have tried to limit screen time for my teenagers. We have tried to directly limit app time and categories of apps. We have tried to get them involved in sports and other activities to consume some idle time. We demand "best effort" for school and good manners.

My teenagers are, by all accounts of my research, "addicted" to reels, tiktok and youtube shorts. Given the lack of understanding, guidance and real research that proves or disproves harm was the impetus to try limiting these apps. It was not well received by my adolescents to put it mildly.

Being that I hold open-mindedness as a virtue for myself, I asked them to construct arguments that would help me understand their point of view and would reconsider if those arguments were compelling. They were.

Both of them put together slide shows with their school supplied chromebooks. They started off telling my wife and I about their grades, which are excellent. They showed that they don't miss assignments and don't have "too many" infractions for misbehaving in class. They showed us their training schedules for soccer and clubs.

My daughter, the ridiculously organized perfectionist, showed use how much time she spends cleaning her room and doing her laundry every month. She is also the biggest consumer of tiktok in the house by a wide margin. She then showed us an example of her feed.

Both had arguments that basically said; "we are responsible teens that get 93% of what you ask done without you asking more than once. We should be allowed to use these apps when we have down time and just want to veg out." I am inclined to agree.

I came away from this thinking about a lot of things. Namely, I am not sure any of the "social media" is bad research can be generalized across a population. The two teenagers in my house have enviable feeds. They watch content that is directly applicable to the activities they do in real life.

Obviously there are stupid videos and funny videos, but the bulk was tutorials and discussions regarding real stuff like nail design, hair styles, clothing, soccer skill drills, math tutorials, weird science stuff, fishing, Golf, and TONS of music dances. I have considered that perhaps we are now the "old people" that just don't get it and because of that have labeled it "bad for you".

I am biased, but damn proud of my teens. We have relinquished a fair amount of control on the "time" aspect. However, we still have boundaries as to when and where they use their phones as a matter of manners and they hold us accountable to them as well. I guess what I am saying is that I don't think "brain rot" is real for everyone.

They have a neat program, but its really hard to defend their pricing model. I gave it a shot and its just way too expensive given the functionality. Yes, they are constantly improving, but the price for me is just too much considering alternatives.

Read through this discourse topic: https://discourse.shapr3d.com/t/why-there-is-no-plan-for-hob...

I don't understand why they do what they do when it comes to pricing.

The debate as old as time, this time "solved" with science?

I was party to an event, at a fire station around 11:15am about 10 years ago, between two senior Engineers (drivers of the fire engines) regarding the best way to boil eggs for the cobb salad we were preparing for lunch. It started out innocent enough and quickly became heated when one of them stated the method proposed to boil the eggs was no better than scooping up "dog shit" and serving it to the boys.

This statement devolved into an actual fist fight. If I wasn't laughing so hard I might have tried to break it up, but I was laughing really, really hard. Thankfully, a very junior firefighter was shocked enough to not laugh and broke them up.

Being a mediocre leader, I suggested we have a cookoff with judges, metrics and scorecards. The winner would get a trophy. OR we could roll out the mats and let them wrestle where the winner can declare which way is the better way to boil and egg. In either scenario, eggs would only be cooked in the manner the winner choose on our shift.

The guys were 55+ years old (near retirement) and friends both on and off the job. They choose to wrestle, and it was even funnier than when they fought. As you can imagine, the judges of the match could not determine a "winner" due to the sheer idiocy of what was actually happening and riotous laughter. We decided to let the most junior person at the station choose how we boil eggs from that day forward. So much fun back then... can't do that stuff now unfortunately.

Looks pretty cool, but I can't use my browser or android? The only reason I use iOS is to manage my family's devices. If it was up to me, I would ditch iOS and move to Android. Unfortunately, being a teenager these days basically requires an iPhone lest you become labeled "basic" as in, not "drippy"... My wife and I have acquiesced to our children's formal proposal (which was a good exercise in debate) to purchase iPhones. I digress.

Are there plans to move this to the actual web, windows, linux and android?

This is pretty neat, but I have to ask; Why does everyone want to build and/or use a headless browser?

When I use pyautogui and my desktop chrome app I never have problems with captchas or trigger bot detectors. When I use a "headless" playwright, selenium, or puppeteer, I almost always run into problems. My conclusion is that "headless" scrapping creates more problems than it solves. Why don't we use the chrome, firefox, safari, or edge that we are using on a day to day basis?

At first glance the "masterpieces" looked like a crap ton of lines and circles around a sketched shell or butterfly. You know, the kind you see when you tell Stable Diffusion to "sketch". Then I watched the video for a sec... WOAH!!! He is talking about a "formula" quite a bit... ctrl-f "formula" == 0 results.

Google: Rafael Araujo artist formula. Ahhhh! https://www.rafael-araujo.com/calculation

Now we are getting somewhere... and another that shows the process a bit better: https://hazelhomeartandantiques.blogspot.com/2015/04/the-cal...

Now I am trawling github to see if I can find some processing or similar libraries that I can play around with. Golden Ratio sketches, defining physical objects and shapes from purely mathematical constructions... I love rabbit holes!

I generally agree with this sentiment and have struggled to put it into words. I have a beefy Dell Precision that I bought used for $200. This is where I simulate all the things; networking, container orchestration, services and more. I have upgraded to 128GB of ECC RAM, PCIe NVMe drives, and a 24GB quadro card. All in, I have about $800 invested. It's brittle as it is also my desktop so I delay updates and what not because I don't want to break anything. Not ideal.

So, now I am left with building another system and I need to decide form factor. Is this going to be headless or run a GUI of some kind with a monitor attached? Should I buy a big ole tower case or move to a 6u or 12u rack system. I want more VRAM and I need as much PCIe as possible. One thing for sure is that I don't want it to be Raspberry Pi based. I have two Pi4 collecting dust that were fun and impressive for what they are.

I saw these mini racks and wondered how they would work with an extended ATX board. Could these be useful as some kind of "open air" or mining type case where you simply bolt stuff on. Definitely going to investigate, so while the exact application of mini-racking pi's is not my jam, I am thankful that it was brought up.

This is true for all newish code bases. You need to provide the context it needs to get the problem right. It has been my experience that one or two examples with new functions or new requirements will suffice for a correction.

Not the person you asked, but I will take a shot at your question. The best python package for getting what you want out of these systems is to use original gangster python with libraries to help with your goals.

For your example; Write a python script with requests that hits the OpenAI API. You can even hardcode the API key because its just a script on your computer! Now you have the GPT-4proLight-mini-deluxe response in JSON. You can pipe that into a bazzillion and one different places including another API request to Anthropic. Once that returns, you can now have TWO llm responses to analyze.

I tried haystack, langchain, txtai, langroid, CrewAI, Autogen, and more that I am forgetting. One day while I was reading r/Localllama someone wrote; "All these packages are TRASH, just write python!"... Lightbulb moment for me. Duh! Now I don't need to learn a massive framework to only use 1/363802983th of it while cursing that I can't figure out how to make it do what I want it to do.

Just write python. I tell you that has been massive for my usage of these LLM's outside of the chat interfaces like LibreChat and OpenWebUI. You can even have claude or deepseek write the script for you. That often gets me within striking distance of what I really want to achieve at that moment.

interesting comment... what are you doing with base models? Are you a "finetuner"? I have been trying my hand with finetunes on instruct models and the results have been ok, but not awesome. I have a base model downloading now to give that a proper shot.

I sort of get the idea, but the page doesn't really sell me on what differentiates it from the competition other than being serverless.

Why is this better than Tailscale, Cloudflare tunnels, Mullvad or just running a wireguard bash script on a machine somewhere.

Furthermore, because its severless, does that mean it has more latency than a typical VPN? For example, I know that when I connect to a Mullvad server, my traffic is going to be quite a bit slower than what it had been.