Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
Spent multiple weeks preparing data for rendering. Part of this process is reprojecting coordinates of huge ass GeoJSON files (some files are 100gb+).
Compared one normal and one reprojected file with the head command and noticed no difference, then found out that this data already comes in the right projection....
Full-speed extraction it is!3 -
Continue of https://devrant.com/rants/2165509/...
So, its been a week since that incident and things were uneventful.
Yesterday, the "Boss" came looking for me...I was working on some legacy code they have.
He asked, "what are you doing ?"
Me, "I am working on the extraction part for module x"
He, "Show me your code!"
Me(😓), shows him.
Then he begins..."Have you even seen production grade code ? What is this naming sense ? (I was using upper and lower camel case for methods and variables)
I said, "sir, this is a naming convention used everywhere"
He, " Why are there so many useless lines in here?"
Me, "Sir, I have been testing with different lines and commenting them out, and mostly they are documentation"
He, "We have separate docs for all, no need to waste your time writing useless things into the code"
Me, 😨, "but how can anyone use my code if I don't comment or document it ?"
He, "We don;t work like that...(basically screaming)..."If you work here you follow the rules. I don't want to hear any excuses, work like you are asked to"
Me, 😡🤯, Okay...nice.
Got up and left.
Mailed him my resignation letter, CCed it to upper management, and right now preparing for an interview on next monday.
When a tech-lead says you should not comment your codes and do not document, you know where your team and the organisation is heading.
Sometimes I wonder how this person made himself a tech-lead and how did this company survived for 7 years!!
I don't know what his problem was with me, I met him for the first time in that office only(not sure if he saw the previous post, I don't care anymore).
Well, whatever, right now I am happy that I left that firm. I wish he get what he deserves.12 -
What kind of rusty asshole develops an FTP client which seemingly treats uppercase and lowercase filenames as exactly the same and is not able to fucking understant UTF-8 filenames!?
OK or maybe it was the shitty ass server to which I had to deploy the website to.
I've never been so pissed in my life.
It's already an asshole torture to upload 2.3 giggle bytes of pixel jizz, but 5 hours later, when the site has been made public, you find out that 25% of these images' filenames were automatically renamed during the extraction because some asshole dev thought it was a great idea to not even inform the user about this behaviour.
Fixing filenames in production while your boss is really pissed next to you the hole time is not a great feeling. Especially when you accidentally purge the whole image cache and the PHP image transform task then blocks thus making the whole site not loading any more images for 40 minutes.
WHAT AN ASSRAPE!
Please don't comment. I'm still too pissed to read comments. Thanks.4 -
Oh boy... something just happened I'd have never expected.
Remember my rants about the PHP CMS Of Doom™?
Guess what... the boss of said company just called me to offer me a job as their new tech lead. WTF.
I'd rather slowly impale myself on a rusy pickaxe.
I'd rather tattoo my face with a giant, pulsating, uncircimcised shlong.
I'd rather take a swim in a pool of Hydrogen fluoride.
I'd rather work 80h/wk on pimple extraction.8 -
After three weeks looking for decent pdf parser that will handle all documents I gathered for my project I decided to write my own.
All those I tried end up with more then 10% not correctly parsed pdfs or require to much coding.
I was sceptic so I waited another week debating if it’s good idea to do it and I said yes.
Spent 16 hours straight coding pdf document extraction library and command line tool based on pdf.js
Fuck, now when I open pdf I see opcodes instead of text.
Got two more hours until client planning meeting and then I go to sleep for a while.
Time to start testing this more deeply as I have about 60k ~ 20GB pdf documents to parse and then I need to build some dependency graph out of its text.
At least it’s more funny then making boring REST API for money.4 -
you motherfucking cocksucking ass wipes.
How fucking hard is it for you JS cockheads to have STABLE fucking code?
So hear I am, thinking through a side project for data extraction and loading to automate some shitty part of my job, that could be used by the broader team... and decide to use electron.... I know it's a clusterfuck, but this wouldn't be a big application, so against my better judgement I run:
npm install electron
npm start
...
Error: unknown spawn
🤷♂️ you had 1 fucking job... 1 fucking lousy shit stain of a job, and you can't even have something run out of the god foresaken box without someone debugging your shit.
Now who has a WORKING alternative to electron?10 -
Tech head fires a mail few days company is planning a hackathon. Overnight at office, with food, music and home drop offs in morning. We devs feel excited we will get time to work on our personal projects and complete them.
Yesterday, tech head fires a mail about the topics. Guess what? The topics are projects which company needs to scale up... Image recognition and text extraction. Selenium. Esign.
Now I am searching for an excuse to skip the hackathon...4 -
In This Rant: A mildly satisfying piece of mind story.
Using code to prove yourself right is a hell of a drug.
A few weeks ago I whipped up a tiny program that downloads configs from hardware we manage. Since the vendor's API documentation is hidden behind a pay wall, my method of extraction is different. It results in bigger files, but testing showed it to still be valid.
Enter today. Interns at work downloaded a config to load onto a spare machine and it won't work.
"TheCapeGreek, your configs don't work"
I was confused since I tested the files when I built it and it worked. I am also currently fleshing out that download utility's features so the fear that I've been wasting the past 2 weeks on improvements is looming.
Last 15 minutes of the day and nothing else to do so I figured I might as well whip up a string comparer. The smaller file's content is scattered in the big file so a direct diff won't work.
Code it all, quick hardcoded proof of concept code, bit it got the job done. I was right, my bigger file is still correct!
Turns out the issue was with the machine they were configuring. They found this out before I finished my test code, so I'm off the hook already, but it was good to have piece of mind haha!1 -
A peeve of mine is when someone in the software industry denigrates a technology/tool/framework outside of his role eg webdevs on sysadmin stuff or viceversa.
I'm not trying to shame anyone for having subjective experiences, I just think that if you're gonna talk about tools that are not on your domain, then you need to be twice as humble as usual.
I'm a webdev and I don't post around how I KNOW how to make ssh secure, while other people devote their entire careers to that and all related matters.
What prompted me is seeing some not webdevs do this here that seem to be sysadmins/devops (can't tell for sure since I don't know them), but in real life, I've seen people from any role do this, webdevs too, even testers!
Imagine you had cancer, and you had a tumor extraction, and the oncologist said to the surgeon "step aside son, let me show you how to deal with cancer".5 -
Why, in 2023, do we still have a path length limit in Windows?
I know it's not that trivial finding a good soution, but at least if I managed to get a .zip which I can't extract in that directory because of a few files with a too long file name, let me know in advance (and not during the extraction) and maybe (amazing idea) let me know how many steps I have to go back in the directories tree to make it work…12 -
Puts three months of work into this project; cronjob to ping 3 APIs at regular intervals, cleans, massive features extraction, dumps into PostgreSQL db. Got Django on top of that with a small neural net and interesting viz - absolutely gorgeous!
Can’t fuckin wait to showcase that.
Feedback: “is that the right blue? I think you have the old company logo! etc”
Mah.LahF3 -
Okay so after a few days of thinking I think I'm sure about what I'm about to write :
Best : Discovering how to use streams while making a service that should extract a tar.gz, extract the tar.gz within it, filter the extracted files and correct some of them, then compress each folder as tar.gz and compress all the archives as .zip. The amazing thing for me is that with streams I could do all the operations in just two passes, maybe one if I had more time, saving disk writing time.
Worst : upgrading a bunch of legacy Access 97 apps and its VBA code to Access 2013 -
Data wrangling is messy
I'm doing the vegetation maps for the game today, maybe rivers if it all goes smoothly.
I could probably do it by hand, but theres something like 60-70 ecoregions to chart,
each with their own species, both fauna and flora. And each has an elevation range its
found at in real life, so I want to use the heightmap to dictate that. Who has time for that? It's a lot of manual work.
And the night prior I'm thinking "oh this will be easy."
yeah, no.
(Also why does Devrant have to mangle my line breaks? -_-)
Laid out the requirements, how I could go about it, and the more I look the more involved
it gets.
So what I think I'll do is automate it. I already automated some of the map extraction, so
I don't see why I shouldn't just go the distance.
Also it means, later on, when I have access to better, higher resolution geographic data, updating it will be a smoother process. And even though I'm only interested in flora at the moment, theres no reason I can't reuse the same system to extract fauna information.
Of course in-game design there are some things you'll want to fudge. When the players are exploring outside the rockies in a mountainous area, maybe I still want to spawn the occasional mountain lion as a mid-tier enemy, even though our survivor might be outside the cats natural habitat. This could even be the prelude to a task you have to do, go take care of a dangerous
creature outside its normal hunting range. And who knows why it is there? Wild fire? Hunted by something *more* dangerous? Poaching? Maybe a nuke plant exploded and drove all the wildlife from an adjoining region?
who knows.
Having the extraction mostly automated goes a long way to updating those lists down the road.
But for now, flora.
For deciding plants and other features of the terrain what I can do is:
* rewrite pixeltile to take file names as input,
* along with a series of colors as a key (which are put into a SET to check each pixel against)
* input each region, one at a time, as the key, and the heightmap as the source image
* output only the region in the heightmap that corresponds to the ecoregion in the key.
* write a function to extract the palette from the outputted heightmap. (is this really needed?)
* arrange colors on the bottom or side of the image by hand, along with (in text) the elevation in feet for reference.
For automating this entire process I can go one step further:
* Do this entire process with the key colors I already snagged by hand, outputting region IDs as the file names.
* setup selenium
* selenium opens a link related to each elevation-map of a specific biome, and saves the text links
(so I dont have to hand-open them)
* I'll save the species and text by hand (assuming elevation data isn't listed)
* once I have a list of species and other details, to save them to csv, or json, or another format
* I save the list of species as csv or json or another format.
* then selenium opens this list, opens wikipedia for each, one at a time, and searches the text for elevation
* selenium saves out the species name (or an "unknown") for the species, and elevation, to a text file, along with the biome ID, and maybe the elevation code (from the heightmap) as a number or a color (probably a number, simplifies changing the heightmap later on)
Having done all this, I can start to assign species types, specific world tiles. The outputs for each region act as reference.
The only problem with the existing biome map (you can see it below, its ugly) is that it has a lot of "inbetween" colors. Theres a few things I can do here. I can treat those as a "mixing" between regions, dictating the chance of one biome's plants or the other's spawning. This seems a little complicated and dependent on a scraped together standard rather than actual data. So I'm thinking instead what I'll do is I'll implement biome transitions in code, which makes more sense, and decouples it from relying on the underlaying data. also prevents species and terrain from generating in say, towns on the borders of region, where certain plants or terrain features would be unnatural. Part of what makes an ecoregion unique is that geography has lead to relative isolation and evolutionary development of each region (usually thanks to mountains, rivers, and large impassible expanses like deserts).
Maybe I'll stuff it all into a giant bson file or maybe sqlite. Don't know yet.
As an entry level programmer I may not know what I'm doing, and I may be supposed to be looking for a job, but that won't stop me from procrastinating.
Data wrangling is fun.
1 -
So today I started looking at an old project (site/api tester) I backlogged due to various blockers.
I started remembering things and after setting up the testing app, I realized it depended on an extraction app that I wrote before that. And this reminds me of the whole start of all this testing stuff going back more then a year ago.
It sorta felt like I just took the cover off a hole? And then remembered how deep it goes.
And thankfully I left myself documentation... Though took me a while to find and still looking... (tracing from 1 project to another) -
!dev !rant
thanks for all of your kind words after i had my teeth extracted ( https://devrant.com/rants/1370525/... )
i'm eating normally now, and i'm learning python faster than ever. i really like sololearn better than codeacademy.2 -
Didn't really know how to categorize, bit of a question/discussion/curiosity, so I put it here.🤷
Just today I read an article that stated about the Netherlands, where the police will use an "AI surveillance camera" (yey buzzwords incoming 🙄, but it would actually make sense(?)🤷) to detect and punish drivers, holding a smartphone. Pictures without smartphone shall be deleted. How would this system work without having non-smartphone pictures? It needs to build a classifier, doesn't it? (To be clear, the system only reports those images to an officer for further analysis and actions.)
I mean let's consider that the images are somehow pre-processed, then some convolution(s) for feature extraction, then maybe some more intermediate steps and at the end apply the results on a classifier. How would that classifier work? Would a probability between 0 and 1 suffice? And if so, report those from 0,5 and above? Or would there be better techniques?9 -
For any webDev in here, is there any open source tools for web data extraction? i've seen imacros and UiPath, maybe you use other tools.5
-
Sigh same bug
Or design flaw
Fuck off
The box it grows to encompass a character for extraction to certain parameters
But if the page has a border it selects the whole page -
Could any dev here explain how do u apply SVM to HOG features? I know what HOG features are but cannot for the life of me figure out how the hell to use them in an SVM -_-2
-
I finally finished up my post on Bibilobunny, my book note extraction tool for Kindle and Play Books:
https://battlepenguin.com/tech/...
I hope to add support for getting notes off Nook and Kobo next. You can follow the instructions to create your own book quote bot, and you can follow mine here: https://tweeflood.com/@bookquotebot1 -
Meiplus Dentalcare: Effective Relief for Toothaches in Marine Parade
Toothaches can be one of the most uncomfortable and painful experiences you can have. Whether it's a sharp, constant pain or an occasional throb, toothaches are often a sign that something isn't right with your oral health. If you’re experiencing tooth pain and need relief, Meiplus Dentalcare in Marine Parade is here to help. Located at 141 East Coast Road, Singapore 428831, our dental team is ready to provide effective treatments for toothaches and other dental concerns.
What Causes Toothaches?
Toothaches can occur for various reasons, ranging from minor to more severe underlying issues. Understanding the cause of your toothache is the first step in finding the appropriate treatment. Some common causes of toothaches include:
Cavities: The most common cause of toothaches is a cavity or dental decay. When bacteria in your mouth break down food particles, they produce acid that erodes your tooth enamel, leading to cavities that can cause pain.
Gum Disease: Gum infection or inflammation, also known as gingivitis or periodontitis, can result in toothaches, as the gums begin to pull away from the teeth, leading to sensitivity and pain.
Tooth Abscess: A severe tooth infection can lead to an abscess, a pocket of pus that causes intense, localized pain. Abscesses require immediate treatment to prevent the infection from spreading.
Tooth Sensitivity: Some people experience tooth pain due to sensitivity, often triggered by hot or cold food and drinks. This sensitivity can be caused by worn enamel or receding gums.
Teeth Grinding (Bruxism): Habitual grinding of teeth, especially at night, can cause toothaches as it puts excess pressure on the teeth, leading to discomfort.
Trauma or Injury: A fall or injury to the mouth can result in tooth pain, either from a cracked tooth, loose tooth, or other dental injuries.
How We Treat Toothaches at Meiplus Dentalcare
At Meiplus Dentalcare, we prioritize your comfort and well-being. If you’re experiencing a toothache, our team of experienced dentists will conduct a thorough examination to determine the cause of your pain and recommend the best treatment options for relief. Here are some of the ways we treat toothaches:
Dental Fillings: If your toothache is caused by a cavity, we may recommend a dental filling. We’ll remove the decayed portion of the tooth and fill it with a material that restores its shape and function.
Root Canal Therapy: If the pain is due to an infection in the pulp of the tooth, a root canal may be necessary to remove the infection and save the tooth. Our skilled dentists use advanced techniques to ensure this procedure is as comfortable and effective as possible.
Gum Treatment: If your toothache is caused by gum disease, we can provide professional cleaning and gum treatments to reduce inflammation and improve your gum health.
Tooth Extraction: In cases where the tooth is severely damaged or infected and cannot be saved, we may recommend a tooth extraction. Our team will ensure that the procedure is done safely and with minimal discomfort.
Mouthguards for Teeth Grinding: If your toothache is caused by teeth grinding, we can create a custom mouthguard to protect your teeth and prevent further damage.
Medication for Pain Relief: We may recommend over-the-counter pain relievers or prescribe medication to help manage your toothache pain while we work on resolving the underlying issue.
Why Choose Meiplus Dentalcare for Toothaches?
At Meiplus Dentalcare, we provide compassionate, high-quality care for all our patients. Whether your toothache is mild or severe, we understand that you want immediate relief and effective treatment. Our clinic offers:
Experienced and Caring Dentists: Our team of professionals has years of experience treating toothaches and a variety of dental issues. We take the time to listen to your concerns and provide personalized care.
Comprehensive Treatments: We offer a wide range of treatments to address the root causes of your tooth pain, from fillings and root canals to gum treatments and extractions.
State-of-the-Art Facilities: Our clinic is equipped with the latest dental technology, allowing us to diagnose and treat your toothache with precision and comfort.
Patient Comfort: We understand that visiting the dentist can be stressful, especially when you're in pain. Our team will ensure you feel at ease throughout the entire process, providing gentle care and effective solutions.
Affordable Care: We believe that everyone should have access to the dental care they need. Our services are competitively priced, and we offer flexible payment options to make sure you can get the treatment you need without financial worry.
1 -
ComPDFKit Solutions
For text extraction technology, ComPDFKit offers the following two solutions that effectively address text extraction for all types of PDF files. For documents containing only text information, our non-intelligent solution can suffice. But for more complex documents and image-based ones, ComPDFKit Document AI offers higher accuracy in text extraction. To learn about the accuracy of ComPDFKit's information extraction, see this article.
1. Algorithm: X-Y Cut Recursion Projection Method
The X-Y Cut Recursion Projection Method is a top-down page segmentation technique that decomposes a document image into rectangular blocks. It employs a recursive approach by projecting along both the X and Y axes to segment a PDF into independent rectangles, facilitating the extraction of textual components. ComPDFKit utilizes this method for efficient text separation and structural organization, including rows, paragraphs, and columns, to retrieve characters, words, lines, and paragraphs from the document.
The advantage of the X-Y Cut Recursion Projection Method is its speed, making it suitable for simple, structured, non-image-based PDF documents. However, for complex, unstructured PDFs, there might be recognition errors or omissions.
2. ComPDFKit Document AI
Document AI is an intelligent text extraction solution supporting all types of PDF files, including image-based. It uses artificial intelligence-based methods for document recognition and analysis to extract textual information from PDF documents (as well as images, tables, etc.).
- PDF Recognition and Analysis: This involves using deep learning models to recognize and analyze PDF documents, extracting elements like text, images, and tables while retaining their position, size, style, etc. ComPDFKit owns well-trained AI models to accomplish this process.
- Image Pre-processing: This process involves improving the quality and clarity of low-quality images in PDF documents, enhancing subsequent recognition and analysis. ComPDFKit employs multiple image processing techniques, such as image sharpening enhancement, noise reduction, document trimming and straightening, and stamp detection.
- OCR (Optical Character Recognition): OCR technology has a wide range of application scenarios such as license plate recognition, bank card information extraction, identity document (ID card) information recognition, train ticket information detection, etc. ComPDFKit supports recognition in dozens of languages. With extensively trained model zoo, it can accurately detect and recognize text in documents and analyze document structure.
1 -
Is there anyone who understands my struggle and can help with this? Until now I encountered only "use virtualenv" and "why do you want to do that?" crap. Virtualenv can't help here at all, so please don't try to be smartpants with that bullshit.
http://superuser.com/questions/...2 -
Need help with selecting a proper backend and website frameworks. After trying out a couple identity verification service providers we were dissapointed with their lack of support (takes weeks to do minimal changes).
So now we are having discussions about building in-house id verification system. We already have libraries for ios/android apps (ZOOM lib for face recognition and another lib for data extraction via OCR from document picture). So what we need is a proper backend and then a decent web framework with proper ux/ui design for our web/ios/android apps.
Currently thinking what kind of backend framework should we choose? Backend's main responsibility is for each client registered from website to assign an api key and to create a database/storage where his users would authenticate via clients app and upload a picture and a video.
Also wondering what kind of framework for website apps (main web app, dashboard app where we display pending verifications, and of course verification app) to choose. Should be go for angular? -
Obviously ai and autodocument recognition and data extraction is not usable yet
Excepting when it's a pdf not a scanned document or image
Ocr may be but shift the whole.image or bend it or remove a border from some white out
And then handwritten -
UnDatasIO is an enterprise platform designed to convert unstructured data into AI-ready assets. Harness cutting-edge document parsing, smart data extraction, and seamless LLM integration to derive valuable insights from documents, PDFs, and enterprise data. Enhance productivity and decision-making with our advanced data processing solutions.
1 -
ABC Locksmith: Your Trusted "Pop a Lock" Service in Winter Haven, FL
If you find yourself locked out of your car, home, or office, the first thing that comes to mind might be the phrase, “pop a lock.” While this term is often used casually, it refers to the expert services that a professional locksmith, like ABC Locksmith, can provide. Whether you're dealing with a lockout situation or need help accessing a property quickly, ABC Locksmith is here to offer quick, reliable, and safe lock opening services in Winter Haven, FL, and surrounding areas.
What Does "Pop a Lock" Mean?
"Pop a lock" refers to a professional locksmith service where a technician uses specialized tools and techniques to unlock a door or vehicle without causing damage. Whether you’ve accidentally locked yourself out, lost your keys, or are facing a malfunctioning lock, our experienced locksmiths can help "pop a lock" efficiently and safely.
At ABC Locksmith, we provide expert lockout services for residential, automotive, and commercial clients. If you’re stuck outside, don’t waste time trying to force the door open or break the window—let our skilled locksmiths pop the lock for you without causing damage or frustration.
Why Choose ABC Locksmith to "Pop a Lock" for You?
Quick and Efficient Service
When you’re locked out of your home, car, or office, time is of the essence. ABC Locksmith offers fast response times and works efficiently to get you back inside quickly and safely. We understand how important it is to get access to your property, and we make it our priority to solve the problem as soon as possible.
24/7 Availability for Emergency Lockouts
Lockouts can happen at any time of the day or night. That's why we offer 24/7 emergency locksmith services to ensure that no matter when you need us, we’re here to help. Whether it’s early in the morning or late at night, if you need to pop a lock, we’re just a phone call away.
Experienced and Professional Technicians
At ABC Locksmith, our locksmiths are licensed, insured, and highly trained to handle all types of lockout situations. We use the latest tools and techniques to ensure that we “pop” your lock without damaging the lock or surrounding property.
Affordable, Transparent Pricing
We know how important it is to provide fair pricing. At ABC Locksmith, we offer honest and transparent pricing. Before we begin any work, we provide an upfront estimate, so you know exactly what to expect. No hidden fees—just affordable and reliable service.
Serving Winter Haven, FL, and Surrounding Areas
Located in Winter Haven, FL, ABC Locksmith proudly serves Polk County, including nearby areas like Lakeland, Auburndale, Bartow, and beyond. With our mobile locksmith service, we come directly to you, wherever you are, to solve your lockout problem on-site.
Our "Pop a Lock" Services
We provide a variety of services to help you regain access to your property, including:
Home Lockouts:
Locked out of your house? We can quickly and safely "pop a lock" and get you back inside without any damage to your locks or doors.
Car Lockouts:
If you've locked your keys inside your vehicle, our auto locksmiths can efficiently "pop a lock" and get you back on the road. We can handle most vehicle makes and models, from traditional keys to high-tech keyless entry systems.
Office or Commercial Lockouts:
Locked out of your office or commercial property? Whether it’s your storefront, warehouse, or office, we offer quick and professional lockout services to get you back inside and minimize downtime.
Broken Key Extraction:
If your key breaks off in the lock, don’t panic. We can safely extract the broken key and help you get a replacement key on the spot.
Rekeying and Lock Replacement:
If you're concerned about security, we can rekey your locks to ensure that any lost or stolen keys no longer work. We also offer lock replacements for added security.
Why You Should Call ABC Locksmith for Lockout Services
Non-Damaging Techniques
Our experienced locksmiths use non-destructive methods to pop a lock, ensuring that your door, car, or lock remains intact and fully functional after the service.
Quick and Hassle-Free Access
We aim to provide you with a hassle-free experience. Our team will arrive quickly, assess the situation, and open your lock without making you wait for hours.
1
Top Tags
Weekly Rant
View