Nevertheless, neat!
53 karma · joined October 5, 2020
Nevertheless, neat!
Down the line, we do everything you cautiously described. We extract single fields with pointers (in lack of a better term, english is not my main language) to the XML/JSON fields we like to extract. Our software then lets us use JS snippets to manipulate the contents. Problem is, once you define a rule, it may get 80-90% over hundreds of datasets. But breakage is not an option most of the time. It's pareto principle work: 80% in 20% of the time, 20% work in 80% of the time. In the end, they are just snippets, then a giant gap, then the projects my colleague does.
I get where you are coming from, regarding "never to do that again". This not the only work I do. I also build HTML from customer demands, many of which are pdfs meant for print use, but not for the web. I like it, but I only scratch the surface of what might be. Thanks to the resources in this thread, I have a good insight of what to come. So, thanks again.
Regex isn't really the problem though (even though it technically should also not be the solution in this case, but I cannot dictate the techstack). It was just the last drop on my frustration with the situation and myself not being able to do, what my colleague does, even though I want to. I felt the need for help, and I got it. Awesome community around here.
Are you suggesting a different technology stack for the fundamentals? Others seem to go the same way, but they are suggesting it within the ecosystem of JS, just not with the overhead of the new technologies.
Having a wiki is a good tip, I already have started to maintain a small database with snippets I use often. But it's just that. My next focus will be having a project which does not have to many features. Baby steps it is.
About my regex problem: This is a structual mess. JSON/XML with HTML code in the data fields. We process them and send them to multiple job boards. Our clients mainly use HRM software or some CMS, some of which are only able to spit out whatever HTML is displayed on their career sites. This code often does not even have classes or IDs. Most of the times we are dangling together whatever is between two headlines, praying those won't change. But they do, because the recruiters put fields, where they not belong. I call myself code cleaner, not web dev nowadays. We are not able to use APIs, because the receiving job boards either don't offer one, the client doesn't, or it's just not worth it financially.
I will take a step back and reevaluate my situation.
I cannot claim to be the epitome of positivity though. I have to work on my views of people in general. Anti-Vaxxers and climate change have left me with deep emotional cuts, consider it weltschmerz.
Are you by any chance driven by outside 'pings'? Extrovert people that rely on direct feedback from others really had/have a bad time. Maybe this realisation or thinking about it may help you understand why you are feeling this way. In the end, every negative situation e.g. a global pandemic, need some form of personal resilience. How to get there is unfortunatley on you to figure out.
Otherwise it all can be sold to much higher prices, being fair and all, but in reality you are just buying the same dubious materials as before. I will never feel like a customer that is treated fair, until I can be sure about the origins of the materials.
Final straw for my private machine: I was not allowed to save in my own working folder. This was on a fresh out of the box install. I'm still angry. I switched to Linux full time after this.
I can not image how it must feel like when you are not having admin privileges. Given it is not a work machine, I would just refuse to go near it. No meditation would be enough to help me stay calm. My heart goes out to everyone who has to deal with this crap, I hope you get good money for it.
I guess a big userbase will always attract people with malicious intent, abusing the tech behind everyday apps. But the original creator cannot do anything, when his or her successor does not weed out the bad. Even if they do, this cycle will never break. Interesting morale problem for open source software developers.