Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Search - "backups"
-
buzzword translations:
"cloud" -> someones computer
"big data" -> lots of somewhat irrelevant data
"ai" -> if if if if if if if if if if if if if else
"algorithm" -> something that works but you don't know why
"secure" -> https://
"cyber security" -> kali linux + black hoodie
"innovation" -> adding something completely irrelevant such as making a poop emoji talk
"blockchain" -> we make lots of backups
"privacy" -> we store your data, we just don't tell you about it40 -
Professor: "Who here regularly backs up all their data?"
*Some people raise their hands*
Professor: "Who has at some point lost their data?"
*The exact same people raise their hands*22 -
They call it $5/gb hotel wifi, i call it free uncapped 100meg fibre because your security sucks
Oh and they host their entire POS (and database with backups) on the same network accessible to every TV in the hotel16 -
Fucked up an sql join once and accidentally deleted myself from the employee table in the prod database. So I kinda fired myself... Good thing we had backups. 😂2
-
| ̄ ̄ ̄ ̄ ̄ ̄|
| backup + |
| encrypt all |
| the things |
|______|
(\__/) ||
(•ㅅ•) ||
/ づ
| ̄ ̄ ̄ ̄ ̄ ̄|
| also test all |
| ur backups |
| so u don't |
| lose all ur |
| things |
|______|
(\__/) ||
(•ㅅ•) ||
/ づ8 -
Dance like noone is watching.
Encrypt like everyone is.
Sudo like you have backups.
Tag like you're a SEO.
Vim like you know how to exit.
Ticket frontend like you're the project manager.
Commit like saying "fuck you" in the message is appropriate.
Alert like you would use console.log
Design like you know CSS.
Comment like you aren't the only dev.
Code like PHP isn't outdated.
And finally:
Try to work like you know how to quit devrant.13 -
I had just started my new job and deleted 3 years of data that the client had spent over £450,000 collecting 😱
another developer used my PC to quickly access the clients database while I was out the room as I had sql management studio open. I went back to my PC thinking I was connected to my local database, did a few truncate tables to test my software and :0 minutes later I get a call asking why there was no data on the server!
Thank god for backups 😓7 -
Dear WhatsApp developers,
GOD DAMNIT CHECK IF THE USER IS TYPING A (LONG) MESSAGE BEFORE BLOCKING AND ULTIMATELY CRASHING YOUR APP BECAUSE OF YOUR DAMN BACKUPS.
Yours,
Everyone
P.S. First rant *yay*, feels good 😁5 -
There's one kind of ticket I fucking love. Wait, YOU LOVE TICKETS?! No, except for one.
Tickets where people ask us to restore backups.
Why do I love them?
Because the only fucking thing I need to do is reply with a link to a helpdesk item on our website because backups aren't something within our support range because it's easy for customers to do.
So whenever a ticket about restoring a backup comes in, it's as easy as opening the ticket, pasting the link with "I'd like to refer you to the following resource: " and pressing fucking "reply"
😄15 -
My local ISP was saving their database backups in an unprotected folder which was literally domain.com/backups
When I downloaded it contained thousands of their clients data.
Reported it to them and got 2 years of internet/tv services for free.
They wanted to hire me but I was still studying in my first year of uni in another city.7 -
At my previous job, the person in charge of the Phabricator server didn't have a backup system in place. I yelled at him until he implemented one.
He had the server perform backups to the same drive. I yelled at him again, to no avail.
Well, after awhile the hard drive started failing, and it would only boot intermittently. After a lot of effort, he was able to salvage part of the backup data, but no more, meaning we lost a lot of bug reports and feedback, and developer tickets. We were able recover all of the older lost tickets from a previous server, so overall the loss was pretty small.
But I think he learned his lesson.
He definitely learned to listen.6 -
The time my sister dropped the external HDD with every single picture of our family between 2000-2009.
I was 16 at the time, and it made me paranoid like I am today.
Three offsites backups, and three local ones currently and always trying to do expand.9 -
Never in my life I was scared as today.
I recently left a big company to work for a small one as the first internal developer.
Had a small issue in the production server. The fix was easy, just remove a single table entry. And... *drum roll*... I forgot to add a where clause. All orders were lost.
No idea if we had backups or anything, I quickly called the one other IT dude in the company.
He had no clue where are the backups and how to find them.
Having some experience with Nmap, I quickly scanned our network and found a Nas device.
There was a backup, whole VHD backup. 300GB of it, the download speed is around 512kb/s. No way I can fix it before management finds out, but then an idea came to mind. Old glorious 7zip. Managed to extract only the database files, sent them to the server and quickly swapped them. Everything was fine... The manager connected 5 minutes later. Scariest 45 minutes of my life...20 -
I fucked up again.
Someone needed a flashdrive for a presentation. Forgot that I keep personal code on on of them for backups (it's always nice when there is no reception to have an offline copy of my code, for instance when we go out into the bush or to remote areas).
I gave them my flashdrive. Forgot it had the code on.
Now someone at head office has taken my program, claimed it as their own - and has just earned themselves a decent amount of money (praised in the monthly company newsletter).
My program has been stolen (by my own stupidity) and butchered. It has been made into something that it was never intended to be.
Fuck that guy.13 -
First broken rule - Publish on Friday
Second broken rule - Delete without backing up
Major screw up - Main folder deleted containing several sites
Major problem - Cannot find anyone on the server team for backups3 -
Linus Torvalds: “Real men don’t use backups, they post their stuff on a public ftp server and let the rest of the world make copies.”7
-
Well. My life is over. I got punchy and accidentally deleted a client’s entire site. Backups and all. Wasn’t paying attention to which specific delete feature I was using and POOF. It’s all gone.
The worst part? I was actually just trying to delete a staging site where I was trying out some stuff to try to win a site redesign contract. Now it looks like I’ll be paying THEM for damages and/or building them a new site for FREE.
I’m so done.27 -
So today I got a call that an end user decided to try to be a developer. He built and ran a bulk edit script on his company's server.....
Without a scaled test....
As root....
From root....
Without backups....
How's this my problem again?
Oh right, it's not (yet)!5 -
4+ years ago, in an interview, I was asked if I was familiar with keeping backups of my code on Google Drive.
When I asked them to explain what that is, they said that after a deployment, they make a ZIP file of the project and keep it on Google Drive.
When I asked about using GitHub/BitBucket they said they don't know what that is and neither do they intend on using it.
So yeah .....12 -
"I should really make better offsite backups"
"Right, this service doesn't do client side encryption"
"Oh this one doesn't have a Linux client"
"OK this one only sets up a single directory you can dump shit into"
"Wtf this one charges more than a high class escort girl"
Whatever... I'm sure my house won't burn down.15 -
When I was in sixth form, I taught my friend how to create empty files using Python. He soon learnt that you could get around the quota enforcer this way.
He was curious to see what would happen if you filled the entire drive to maximum so he ran the code for an ~8TB file. Before he could delete it, he was told to log off. Nobody could save their work and backups weren't performed for 24 hours.
It's safe to say they weren't impressed when they found this.9 -
TL;DR: disaster averted!
Story time!
About a year ago, the company I work for merged with another that offered complementary services. As is always the case, both companies had different ways of doing things, and that was true for the keeping of the financial records and history.
As the other company had a much larger financial database, after the merger we moved all the data of both companies on their software.
The said software is closed source, and was deployed on premises on a small server.
Even tho it has a lot of restrictions and missing features, it gets the job done and was stable enough for years.
But here comes the fun part: last week there was a power outage. We had no failsafe, no UPS, no recent backups and of course both the OS and the working database from the server broke.
Everyone was in panic mode, as our whole company needs the software for day to day activity!
Now, don't ask me how, but today we managed to recover all the data, got a new server with 2 RAID HDDs for the working copy of the DB, another pair for backups, and another machine with another dual HDD setup for secondary backups!
We still need a new UPS and another off site backup storage, but for now...disaster averted!
Time for a beer! Or 20...
That is all :)4 -
We had issues with lack of disk space on our production SQL server. Another developer decided to delete the databases he thought weren't in use to clear some space.
Ever think about checking first?!
Production chaos!7 -
This is from my days of running a rather large (for its time) Minecraft server. A few of our best admins were given access to the server console. For extra security, we also had a second login stage in-game using a command (in case their accounts were compromised). We even had a fairly strict password strength policy.
But all of that was defeated by a slightly too stiff SHIFT key. See, in-game commands were typed in chat, prefixed with a slash -- SHIFT+7 on German-ish keyboards. And so, when logging in, one of our head admins didn't realize his SHIFT key didn't register and proudly broadcast to the server "[Admin] username: 7login hisPasswordHere".
This was immediately noticed by the owner of a 'rival' server who was trying to copy some cool thing that we had. He jumped onto the console that he found in an nmap scan a week prior (a scan that I detected and he denied), promoted himself to admin and proceeded to wreak havoc.
I got a call, 10-ish minutes later, that "everything was literally on fire". I immediately rolled everything back (half-hourly backups ftw) and killed the console just in case.
The best part was the Skype call with that admin that followed. I wasn't too angry, but I did want him to suffer a little, so I didn't immediately tell him that we had good backups. He thought he'd brought the downfall of our server. I'm pretty sure he cried.5 -
left a company over 3 years ago because they wanted me to dumb my code down so that the other devs could understand it. they wouldn't allow me to use classes in my code lol. anyway, 3+ years later figured I would try to log in to some of the admin panels... passwords still the same. MySQL dbs... passwords the same... cpanel... passwords the same. smh. even if I still worked there the passwords should be changed every so often. top notch security right there. funniest part is they don't even do backups or use VCS for the code. sad sad company. glad I'm no longer there. my personal projects have more security, redundancy and fail over lol4
-
Well fuck me in the ass and call me Charlie.
I just had to bare witness to 2 years worth of files being deleted due to a minor.. well.. minor in the sense of not checking for an empty string, but massive fucking bug.
Thank all the gods of all the religions for backups!!4 -
Last week my brother was visiting. I did some advanced partition management for his girlfriend (preparing a hard drive for backups) and used a Linux live system with gParted for that.
That's when he said "I guess it's time, that I get into Linux - what do I need to get started?".
\o/4 -
I recently got a job as a sysadmin and they've been debriefing me on their hacked websites (wordpress malware injection). Beats me why they still have their sites up at all...
BUT WAIT THERE'S MORE!
I wanted to see if they have any backups... NONE.
The latest snapshot was over a year ago...FML. Over a year ago when they barely have anything on their company site and client sites 😒
Now, I have to revive 10 websites from redirection. Time to do some shell scripting!4 -
A recent project actually taught me how HORRIBLY STUPID it is to store large bodies of text in a SQL Server database. There were millions of records with pages of compressed text each.
More and more text records pile on every single day. Needless to say it was becoming super slow and backups were taking WAY too long.
After refactoring them out as compressed files to disk storage (I love you, micro-services) and dropping them completely from the database, the backup size went from 90gb to 3gb!
It's not every day you get to see a dramatic result like that from a refactor.
Lesson learned, and yes it was quite cool.6 -
So today i thought about setting up backups on my server.. Guess what..
HDD broke randomly overnight.
Cool story bro.
Fuck.2 -
At work for a bank, I changed the target SQL Server in my SSIS project and arbitrarily, all my custom-coded scripts were erased!!
I didn't take backups and I spent a week coding them! Fuuuuuuuuuckkkkk 😠
Ended up rewriting them.
I learned my lesson... 😥2 -
Good morning everyone^^
I just heard my company is doinig some weird shit.
1. We RECOMMEND doing backups on a USB stick (our customers get a cheap giveaway when they purchase our products).
2. We sell farm controllers with less power than a fucking arduino as "Top Notch technology". (single core 1Mhz, 128MB RAM)
We Devs are not supposed to understand this logic. We shall only "make it faster". If proper solutions are suggested it gets shrugged off as "expensive".17 -
Coming home for xmas: fixing the router, configuring new smartphones, doin backups and listen to your mum complaing bout her "linus" system 👌🏻😂3
-
A few days after deploying a big important Website into production, I wanted to copy the whole thing including DB back onto our test server for future testing/bug fixing if something comes up. (Last changes were done on production server before going live)
So I opened SSH, removed everything on the test sever aaaaand then I realized I was connected to production...
Took about an hour to get everything up and running again. We didn't tell the client and hoped it would not be noticed.2 -
I once created a folder mistakenly named “~”. The next logical step was to fix this mistake, so I mechanically ran “rm -rf ~” ...
The saddest part is that after recovering most of all my files through countless backups, I still miss 50Gig of data, without having any clue of what it could be XD4 -
Client initially requested the Wordpress server to have an easy one click way to restore from previous backups.
After setting up the auto weekly backup feature in Digital Ocean, the client wants to disable it because of the extra $1 cost it added to their $5/month hosting plan... 😒8 -
WannaCry hit one of our server and the latest backup we had was from May 2017. You know who got blamed? Developers. I repeatedly told the General Manager that SysAdmin are the once who should be doing backups, Server updates and management as per their job description yet we got blamed for it.
I don't know what the fuck is going in this world.9 -
It was like 9/11 at work this morning. Someone had clicked a link yesterday that recursively encrypted our entire file system. Thank god for backups.6
-
So ehm, tl;dr: KEEP DAILY BACKUPS. EVEN IF SOMEONE SAYS NOT TO.
7:48
Manager: Hey Tom, is the server down?
Me: Nah, should be ok, I just did some maintenance this sunday.
Manager: But I can't get [some work data from SQL server]
*Nervous giggle*
9:14: Some random off-site cunt they hired didn't read the notes that said "DO NOT REMOVE DATABASE [xyz]"
9:20-ish: Web don't even have the DB. And you said that we'll figure out what to do with backups later
*Suddenly manager starts to panic*
11:47: Found backup of the entire server on and old server that we had for spare parts, still running tho.
12:something: Everything back up and working.
Really glad I kept the old server running and doing daily backups. Saved our ass for the second time. And finally, new off-site backup is planned this week.3 -
Accidently deleted user table on production database and some backups where broken. Had to deploy a 4 days old backup...6
-
Me to customer, several years ago:
Your server is over 10 years old, and the support for it will soon be gone together with the possibility to take backups. You should upgrade your website ASAP.
Customer said:
ok, we will look into it.
This day:
Customer:
Hi, our site is down and we need backups from yesterday. Can you please fix?
Me:
Sorry, no. *send copy of the email several years ago*2 -
I'm so pissed today .... As someone decides to drop the entire database and the backups intentionally because he is jealous of my department doing better .
While I was coding and accidentally punch against the wall and this happened47 -
Finally got my new phone (from China) today.
*Opens package all excitedly*
*Backups everything to pc of old phone and gets ready to swap the simcard*
*Notices that the new phone only supports a nano sim*
*Realizes that I only have an old school simcard that you can't cut down to nano size*
*Realizes that I'll have to wait until after the weeked to receive the new simcard*
FUUUUUUUUUUUUUUUUUUUUU.
I want to play with it now :(12 -
I hate GoDaddy, we all hate GoDaddy. We know this. I had VPS running a single site that was there for 8 years and only hanging on there for a few business reasons. It was to move this past May to another server, then June, then July ... continually waiting for the final phase to pass so I can move it. Backups running nightly to a separate GoDaddy FTP server ... for 8 years. All good for 8 years. Our company gets a new credit card ... I'm away and forget to update it with GoDaddy ... billing fails 3 times and they delete EVERTHING. No care about being a good customer for 8 years (14 total with other servers), no phone call, no nothing. Poof, gone. Now, I know I should have transferred backups locally or, at the very least, somewhere else. I just never expected this type of treatment. FUCK GODADDY!12
-
"Wanted: Dangerous PHP Developer"
I edit on live during peak hours with no backups using basic Notepad over an unencrypted network. That dangerous enough?4 -
>got 2TB storage upgrade for Xbox One S
>plugs in
>format went well
>queue up ganes to download to external storage
>all is fine
>whoops a game crashed and hanged the console
>force-reboot xbox
>OH MY GOD ALL THE GAMES ARE GONE ALL OUR SAVES ARE GONE EVERYTHING'S GONE
>well at least the saves are all cloud saves
>wait why are they not resyncing
>Turns out you can sync saves upward but not downward if you don't pay for Gold for ALL ACCOUNTS ON THE XBOX, and gold family share doesn't count
>mfw Microsoft is ransoming save backups now10 -
Three days I'm not there, three bloody days and the 2nd sys admin has managed to:
Destroy the auto load balancing that I have scripted and implemented
Fuck up the backups to the cloud, and to a tape drive.
Overload a physical server (in pic, #1 and #2 are hypervisors). This is just one smaller site, I would hate to know what he has done elsewhere.
This is why I'm moving into dev.5 -
*looks for jobs in system administration*
For our client in $location we're looking for a Network and System Administrator ... to manage our local IT infrastructure (so far so good) ... that's Microsoft-based.
Fuck that company.
*looks further*
Requirements: deployment and maintenance of servers, backups and storage, updates, yada yada.. fine with me.
yOU wiLl mAiNtAiN WanBLowS sUrVaR sYsTeMs
Fuck that company too.
Does anyone here in Belgium even work with fucking Linux servers?! Or should I really relocate to the Netherlands to get something decent?!!28 -
For the record, Equifax didn't *lose* everybody's personal data. They just made unintentional backups of it, your Honor.2
-
today I'm 30, and just like the guy two weeks ago, I'd really love a stress ball.
but that some ain't going to cut it anymore, so here is a great comic:
alt text: Maybe you should keep FEWER backups; it sounds like throwing away everything you've done and starting from scratch might not be the worst idea.3 -
I had a dream that I was installing some sort of package and the PM warned that it was a known malicious package and I was like "This must be a mistake, no it isn't" so I installed it anyways and then an ASCII-Art Michael Jackson started dancing on my screen to loud music and I shut down the computer and woke up and panicked because I didn't have any backups4
-
there was a job I had where we were only allowed to share code by taking screenshots and we made backups by printing off screenshots5
-
Today my RAID system for backups crashed. Three hard drives died all the same time. This day cannot get even worse.14
-
Client: Content is missing from my Shopify site that was there a few days ago. Please restore.
Me: But I didn’t touch your site. And Shopify doesn’t have backups to restore from.
Client: Please restore.
Me: ...2 -
It is a sincere request to all the people who are asking for a backup of their files and documents, to please stop pestering us regarding the same.
We can't possibly collect your data, and even if there's a way, it would be nearly impossible for us to find your data from billions and billions of files and directories.
Citizens are requested to please understand our problems.
Have a nice day :)4 -
I woke up early and thaught I could finish some database work today.
Beeing tipsy I deleted two production tables and shit my pants.
Luckily I do backups since the last retarded db-deletion.8 -
Deleted a servers crontab by executing crontab -r instead of crontab -e (typo mistake)
crontab -r deletes the users crontab without any confirmation and, just to top it off, the e key is located right next to r. WTH
At least we have backups.3 -
And this, ladies and gentlemen, is why you need properly tested backups!
TL;DR: user blocked on old gitlab instance cascade deleted all projects the user was set as owner.
So, at my customer, collegue "j" reviews gitlab users and groups, notices an user who left the organisation
"j" : ill block this user
> "j" blocks user
> minutes pass away, working, minding our own business
> a wild team devops leader "k" appears
k: where are all the git projects?
> waitwut?.jpg
> k: yeah all git projects where user was owner of, are deleted
> j.feeling.despair() ; me.feeling.despair();
> checks logs on server, notices it cascade deletes all projects to that user
> lmgt log line
> is a bugreport reported 3(!) years ago
> gitlab hasnt been updated since 3 years
> gitlab system owner is not present, backup contact doesnt know shit about it
> i investigate further, no daily backup cron tasks, no backup has been made whatsoever.
> only 'backups' are on file system level, trying to restore those
> gitlab requires restore of postgres db
> backup does not contain postgres since the backup product does not support that (wtf???)
> fubar.scene
> filesystem restore finished...
> backup product did not back up all files from git tree, like none of refs were stored since the product cannot handle such filenames .. Git repo's completely broken
Fuck my life6 -
Joined a call during a potentially important life event. Work laptop password expired this morning, personal laptop didn't connect to vpn, desktop not connecting to vpn. No one knew what's wrong on the call (just that it's not working).
Not a good call.1 -
Dev: I think I just deleted data I shouldn't have. Can you do a rollback?
Me: No, I'm a DBA, I don't touch data. Did you commit?
Dev: Yes, I committed.
Me: Your data is gone.
Dev: But don't you guys do backups?
Me: We backup the Prod servers. We only back up Dev on request. Did you request a backup in Dev?
Dev: No.
Me: ...
Dev: The Testers are going to be pissed.1 -
Pro tip:
Make sure you can RECOVER from your backups.
It's all well and good backing this and that up, but make sure that when the shit really hits the fan you can recover.
I've now 4 days into recovering a raspberry pi that ran:
Pi-hole
Snort
DHCP
VSFTP
Logwatch
Splunk forwarder
Grafana
And serveral other things... I've learnt my lesson4 -
Man, what a way to start the week. Our mailserver went nuts (something about a Shellbot virus, I don't know) and we were forced to migrate to a new one. Clients calling in panic and threatening to sue us and shit. I was the one tasked to fix the problem (I am a developer mind you, my sysadmin knowledge is limited to google searching and contacting support). At the same time, Turkish hackers attacked our other server and forced me to fetch backups and clear spamming scripts. And to top it all, I was forced to answer the phone calls and respond to the threats. Man, I must have been a complete prick in my previous lifetime to deserve this.4
-
At my first job I had a senior who took backups of code by zipping it and uploading on Google drive. Once I told him why don't you use git, he said it's not as secured as Google.
I left the job one month later2 -
Forgot to secure my mongo db instance, found half the data gone, and a new db holding me at ransom , learn_how_to_recover_your_data , good thing offline backups are a thing.
Recovered in no time, never will I ever repeat this mistake3 -
"Why is the production database empty?"
Obviously, we had backups, but using the situation to make my employer shit his pants were funny. And yes, I'm still there5 -
Due to hardware failure build server was wiped out.
So all configurations are gone.
- There is no code to recreate builds
- No backups :D
The bright side, we can finally do it right ;)2 -
Tip of monday:
Test your restores, not your backups.
Just got f#@ed by trusting the log, not the restore folder size1 -
So this just happened. I was working on a project and I just found a weird directory named '~' in there. I am on Linux so I simply did an "rm -rf ~" :/
It was too late when I realized it deleted all my files in my home directory. All my projects and configuration files. The sad part was it did not delete that shitty random directory because permission denied. Thank God I got into the habit of making weekly backups of my system and Thank God I use git.5 -
One of my hard drives S.M.A.R.T. said it could fail anytime and I should backup my data. I cut all the files to a new hard drive.
Later that week the new drive fails with the needle falling into the magnetic disks... Fml.
Should've saved those files on the cloud...9 -
Just had a fire at work.
git add, git commit, git push.
No one was hurt. But, the fire was in a server room and the git server is down. At least the halon deployed successfully.
The off site backup should be up in 20 mins. I wonder how often they pull the repo.3 -
"UPDATE table SET field = 1"
Neglected to include "WHERE ClientId = XXX"
1800 users loose access to thier software in the middle of the day
Restored in 10 minutes thanks to disaster recovery policy.3 -
last day, 1 h 50 minutes left
now they ask about passwords, how is it with the backups and so on.
Well told him 3 months ago that the backups is on my server at home and I will remove the backups today ...8 -
So I've been working on this website now for a while and I'm finally near the end.
The client suddenly writes to me to ask me why there is captcha on some of the forms (register, post). He asks me to remove all captchas.
I explained to him why captchas are important and I even told him one old story of mine (basically I was noob and made that fatal mistake and suffered).
His response is to remove them anyway he didn't like them.
My response?
I keep this conversation in text form and screenshots, and I keep backups of it.
I have a feeling I'll need them.6 -
Me: deployment exploded, the database has to be restored.
C: yeah, the latest backup we have is is from Q1 2016
Me: wat? We have almost weekly changes of the database layout, let alone the content.
C: yeah, you have to execute somewhat 60 sql files ... Have fun
* Sitting in a corner and staring apathecally at the wall*5 -
Pretty fucking sure it’s Monday... Critical Server KO’ed during hours... Going to be a long day....
Sucks not having the funds to implement preventative maintenance and redundancy... Thank god for fucking backups.
To the Level C’s in our company.... take this as a wake up call you incompetent, undereducated, no dick-having-ass’, spitfucks!4 -
I just noticed that my desktop still has a DVD-RW in it that I never used.. which led me to think, I've got here like 5 DVD-RW's as well as 5 CD-RW's, but I never use them. Are there still any uses for them? Long-term backup storage for example? I've heard somewhere that data rot can happen over the course of a few years.. but would it really be a problem? I mean I've had these for over a year already and they look healthy to me. That said, they've never been used and just sat on the top of my desk in their enclosures all the time.
FWIW, I'm having 10TB of storage (as well as some other smaller stuff here and there.. maybe 500GB or so) in various hosts and 3 mirrors, so the need for backups is already fulfilled.. it's merely a curiosity of mine as in "ah, I still have these things huh".. so yeah.
I think that I've bought these DVD's for something like €6 for 5 pieces in a local store that doesn't specialize in this sort of thing, so I'm fairly certain that I could get them for cheaper elsewhere.. think the likes of AliExpress etc. Would they be a viable technology to maybe still invest in over hard drives for long-term storage purposes, considering that the cost of a hard drive these days is only €50 for 1TB? But I guess that tapes would be better for this purpose, no?9 -
Okay karma, why?!
I made some backup scripts, it should dump our MongoDB every 30 Minutes... Nope I didn't test if there's something in the tar and yes it's my fault but now we needed this backup AND THE ONLY BACKUP SCRIPT WHICH DIDN'T WORK WAS THE ONE WHICH BACKUPS THE DATABASE...
COME OOOOON8 -
Worst issue you got blamed for, but wasn't your fault.
Best story about a dev you know who's angrier than you.
Best time backups saved your ass.
Story about a traumatic dev experience.1 -
Discovered yesterday that my boss does tests with production database... and I'm responsible for the fucking backups and he doesn't even care to let me now when so I can at least schedule one at slave. Come on... it's not that hard to let others know or test on your own machine...1
-
There goes a week of work. I accidentally overwrote my Node server, in production, with a client script, without backups.5
-
I bought my first VPS today. After years of hosting my email, websites, databases and backups services on my own physical servers both home and in real serverrooms.
Strange feeling, but it feels like something heavy was lifted from myself, I do not need to buy hardware if something fails.13 -
I have previously worked with a company where they were copying project codes through a USB and making local backups of the whole project with dates and not using git.4
-
One time, I accidentally deleted all the data from one of the client's database table (invoices) because i forgot to comment the line from the script.
Good thing there were some backups and I was able to restore everything without anyone noticing. I was so fucking dumb at that time and I felt all the blood rush to my head at that moment when I did a SELECT * and NOTHING was displayed on the screen.
Rookie mistake.11 -
Running a wild UPDATE statement against an inventory database, it was chaotic and didn't have backups.... yea I know 😅 the backup service died god knows when and no one noticed. I was only new at the time so #notMyFault
UPDATE stock_on_hand = 0; WHERE id IN(1,2,3,4,5,88,972,7388);
# rows affected 1,234,567,890
> I think I almost died inside.
Oh the fun that mess was to clean up.
The positive outcome of this was, we had backups working again not long after and the inventory counts where accurate after that stock take.3 -
Me: so how are you doing backups?
Client: Well, I make a snapshot twice a week, that should be fine, right?
...5 -
Fuck google cloud platform. My server has been down for last 4 days. Stupid reason google gives me is that it does not have resources available in my zone. Why the fuck do you start a hosting company if you cannot provide RAM and CPU. On top of that their support is so bad that after 20 emails, 4 chat tickets, 3 phone calls nobody knows the issue I am facing. They just give the links to their ultra stupid documentarion.
Now all my 6 projects are down. Clients are getting impatient. I cannot do any work and googles support is the worst.
They dont even want to understand the issue, dont know how they will solve it.
I have created AWS instance now and migrated to AWS. But i have old backups which are useless on AWS. To get the latest backups i need google cloud instance to get started but stupid google does not have resources. How hard it is to add 1 CPU and 1GB RAM?18 -
Our documentation is currently stored in a VM image after the host died, meaning we have no access to anything - good times!5
-
Several actually
- root DB access on production
- git commit -am "Stuff" (message)
- Not doing backups
- Using personal licensed software for company work
- 1 commit per day or weekend
- Taking work to home1 -
This summer was my first internship and the developers at the company weren't using any version control.
It was literally painful to see the engineer (my mentor) make backups of each file before changing anything in it.
I really do feel, version control should be included in our courses as well.14 -
Is it just my random madness...
Or do you sometimes picture yourself in a fictional comic / movie / whateva...
Had this feeling today.
Burned a database down, grilled 2 terabyte of data, deleted ~ 500 elasticsearch indices.
Then I chopped an haproxy loadbalancer into 6 seperate machines, because noone likes to read ~ 2.5 to 3 k of lines.
And I guess now I'm doing some backups of elasticsearch before the second round of flamethrower madness starts.
It's somehow very satisfying to just destroy everything.3 -
Updated the site Joomla from 3.6 to 3.7. Then got a call saying some pages weren't working. "No problem," I said, "we have backups." Restored a backup, but then found out it was corrupt... The entire site went down 😭5
-
Apple drops plan for E2E encrypted backups after FBI pressure: https://reuters.com/article/...
And one step at a time, the world goes deeper and deeper into shit...8 -
Hard drive head crashed and corrupted my entire android app source code which took my 5 months to build. I was depressed for 2 days and then started working for it again and updated the app on the store in 3 months. It was a terrifying yet amazing experience. Definitely don't want to go through that again.
Now I keep backups on the cloud. Lesson learnt.7 -
Back when SharePoint was still foreign to me, and I didn't know the pain of administrating it, I had the idea that files were copied to my local machine. I saw no need to preserve backups from before I started, especially since they already existed on the server, so I got rid of them.
Also hooked up to SharePoint was an email handler. Whenever a case was created or deleted, an email went out to the entire department. Guess what happened when I deleted 250,000 records?
Fortunately, SharePoint has a recycle bin. Unfortunately, restoring those files generated another 250,000 emails. To the whole department.
I bought many donuts to appease the crowd baying for my blood.2 -
Lesson learned the hard way: Remember your SSH Ports or write them down...
On the bright side of things, i had backups this time! Tyy DigitalOcean :)8 -
An enormous government project that leaves the tax office's database along with all backups exposed to SQL injection.
I know for a fact that the tax office database in at least one country only got a cold backup a few years ago, so it's more likely than you think.
Although around that time someone hacked the public transport company and bought a 12 month ticket for free as PoC and he got jail for it so the risk is quite high.5 -
Make. Fucking. Backups...
I had to find a MailChimp sync plugin for a webshop and thought I found a good one that synced one way (webshop to MailChimp).
I figured, meh, what could go wrong? So I installed it, ran it...and somehow lost around 4000 mailinglist receipients because they were not in the webshop.
Turns out it adds the registered users in the webshop, but also removes entries that are not! Needless to say, I had some explaining to do and was only able to recover about 3000 addresses from a previously sent campaign.
Customer was not happy, neither was my boss, very important lesson learned...1 -
Boss wanted me to make changes in company's website which was based on wordpres s.
I knew it could be done by tweaking some JS code, but I have very less experience with wordpress
But wordpress is easy man(Internet told me).
Give me 5 minutes, you will see the changes in production.
Being lazy af I directly logged in to ftp, checked out some files, updated some code, I was good to go.
Before pushing it, I opened the website and it was GONE ٩(๑´0`๑)۶
Now there was no public_html in the root.
I was fucked. I have accidentally deleted the website that had no backup.
And the best part I was on leave from
next day.
I was looking everywhere for backups, looked into google cache to get the contents. I have to recreate the complete site now.
Just when I was asking questions on choice of my profession and simultaneously looking here and there in FTP for backups,
I found the jewel "public_html".
It happens out that I have accidentally moved the folder to some other directory.
Phewww.
Moved it back to root. Site was up and running.
Reassured myself that I deserve to be a dev.
Backed up complete site, made the changes.
Uploaded it.
And the best part, amount of wordpress I learned in those three hours was way more than I could have learnt in many weeks.
Lessons Learnt :
A) ALWAYS keep backups.
B) You SHOULD NOT make changes on prod directly
C) You become superhuman when your brain know you are going to be fucked 😂3 -
Made a backup script today that backs up our site files and database (total size 34gb, we have 70gb storage)
the script takes 1:10 hours to far the website files and backups up the database and somehow when running in a detached terminal because my boss wanted me to run it at 4:20pm when I'm leave at 5:05pm( what could go wrong) it went in a infinite loop and filed our storage.
Our provider just called our boss that his drive is full ( why can you even see that)
Well it will not be a fun morning tomorrow6 -
This is why you should make a knowledge database and never trust the internet to keep things
Two quality rants with a lot of useful information I favorited are missing, surely because their authors removed their account
Lesson learned. One more resolution to apply for 202112 -
Git is distributed. What's on gitlab it's also on my 3 different machines. So I have 3 backups for the code. Not such a big deal except issues and PRs.6
-
I don't know why universities dont tech version controlling.. i used to save backups of my final year project as a RAR files. I mean when I started the job and got to know the git. It was enlightening..7
-
Rant considering the latest Cyber attack and the news around it.
(A recap: a lot of Windows computers were infected with ransomware (due to security hole on Windows), which demanded 300$ in bitcoins to unlock data. After 3 days the price would double, and after 7 days the data was to be deleted)
1) In our country, one of the biggest companies was attacked (car factory). The production stopped and they got for around 1 000 000€ damage in less than 24h (1300 people without work). The news said that they were attacked because they are such a big company and were charged more, as the hackers "knew who they were dealing with" - another reason being the fact that the text was in croatian (which is our neighbor country), but noone realized that it is just a simple google translate of english text - which is obviously not true. The hackers neither know nor care who is hacked, and will charge everyone the same. They only care about the payment.
2) In UK whole (or large part) of medical infrastructure went down. The main thing everyone was saying was: "Nobody's data is stolen". Which, again, is obvious. But noone said anything about data being deleted after a week, which includes pretty much whole electronic medical record of everyone and is pretty serious.
And by the way, the base of the ransomware is code which was stolen from NSA.
All that millions and millions of dollars of damage could be avoided by simply paying the small fee.
The only thing that is good is that (hopefully) the people will learn the importance of backups. And opening weird emails.
P.S. I fucking hate all that 'hacky thingys' they have all over the news.5 -
All hail database backups.
Today my worst development related nightmare happened, I managed to screw a production database at work.
Thankfully we had a backup from 2 hours ago, I’ve never been so thankful to scheduled backups.
Take it from me, do backup your databases even if it’s annoying to do.
Piece and merry Christmas ✌️1 -
I was cleaning up my hard drive and deleted some old directories.
I was notified that my backup just started and wanted to look how far along it was.
However, instead of 'ls -l /mnt/DATA/Backup' my shitpile of muscle memory typed 'rm -rf /mnt/DATA/Backup'... That's when my harddrive suddenly had 750GB of free space and I decided that I probably need some sleep.
Before any of y'all wanna lecture me on off-site backups, funny thing: Today I implemented a new daily backup routine (praised be borg) and therefore deleted my somewhat chaotic Backups on my NAS "Because if shit hits the fan, I still have my local Backup"2 -
Boss: hey can you loop through all the entries in the data base (PHP) to make a menu of everything?
Me: me sure thing, shouldn't be a problem
10 min in playing with the database...and I remove the table...FUCK ME?!!??!!!
good thing we backed up the night before 😂😂1 -
Well... I once accidentally deleted a classmates entire assignment. Basically we were working together on one and we had the code in Github, I had named the repo after the module code.
He was having some weird git issues and I thought it would be easier to just delete and re-clone on his machine. You can probably see where this is going.
Me: rm -rf <DIR NAME> Enter
Him: wait, which folder did you just delete
Turns out he had the repo cloned inside another directory with the EXACT SAME NAME, which also contained his previous assignment, the only copy of it in the entire universe (it was a group project and they did it all on his laptop with no source control, which i found hilarious).
It wasnt so bad since that assignment was already submitted and graded, but a bit of a fail on both our parts. -
PSA: DON'T I repeat DON'T use DD before noon.
You will end up like me and overwrite your primary data drive which you haven't backed up since over a year. This method has a 100% (1/1) success rate and will drastically decrease your will to live.
Also FUCK MONDAYS!4 -
Sometimes I wonder how software development in (bigger) teams worked in the 90s.
Take the first Pokémon games for example. It was the mid-90s and the final product would be Assembler code that goes onto a cartridge with limited space.
I believe version control systems didn't really exist back then (Git & Mercurial: 2005, SVN: 2004). So probably people took backups of the chunks of code they worked on, copied around a stitched-together code, threw everything together at the end of the day, etc. etc. ...
Does anyone here know if there is some kind of documentary about that topic or did anyone here experience that first-hand?
It would be really interesting to see how that stuff worked back then 😊4 -
Always quadruplecheck your qoutes kids. Did an oopsie with our NAS that i created and the bash script that did backups deleted root4
-
It's sometimes really anxiety inducing thinking that all data could be gone, if somebody decides to kill/discontinue/crash [see gitlab shitting 6 hours of data due to fucked backup strategy and shitty seperation of servers] your account/service, be it server, git-repos, backups, chrome syncs, games, music, sim card, ..
But there's simply no way of having a backup of absolutely everything (ignore DRM) - especially automated and abstracted away from you, so you don't have to do all that shit yourself13 -
Beware: Here lies a cautionary tale about shared hosting, backups, and -goes without saying- WordPress.
1. Got a call from a client saying their site presented an issue with a third-party add-on. The vendor asked us to grant him access to our staging copy.
2. Their staging copy, apparently, never got duplicated correctly because, for security reasons, their in-house dev changed the name of the wp-content folder. That broke their staging algo. So no staging site.
3. In order to recreate the staging site, we had to reset everything back to WP defaults. Including, for some reason, absolute paths inside the database. A huge fucking database. Because WordPress.
4. Made the changes directly in a downloaded sql file. Shared hosting, obviously, had an upload limit smaller to the actual database.
5. Spent half an hour trying to upload table by table to no avail.
6. In-house uploads a new, fixed database with the help of the shared hosting provider.
7. Database has the wrong path. Again.
8. In-house performs massive Find and Replace through phpMyAdmin on the production server.
9. Obviously, MySQL crashes instantly and the site gets blocked for over 3 hours for exceeding shared hosting limits.
10. Hosting provider refuses to accept this was caused by such a stupid act and says site needs to be checked because queries are too slow.
11. We are gouging our eyeballs as we see an in-house vs. hosting fight unfold. So we decide to watch a whole Netflix documentary in between.
12. Finally, the hosting folds and enables access to the site, which is obvi not working because, you know, wrong paths.
13. Documentary finishes. We log in again, click restore from backup. Go to bed. Client phones to bless us. Client’s in-house dev probably looking for a cardboard box to pack his stuff first thing in the morning. \_(ツ)_/¯ -
Just wanted to remind everyone to remember to backup their files 🙂.
Ubuntu just crashed, had to reinstall the OS, luckily for me, I did all my backups and probably lost 30 seconds worth of work.14 -
As a Dev in college working for teams in college, I don't really have a need to use git, since most of 'self proclaimed prestigious programmer child prodigies' I work with have no idea what it is; but I use it anyways as good programming practice and ease of backups.
So I tried using a GUI client after months of the git bash, and even though I looked up a few tutorials (was embarrassed the whole fucking time). I ended up adding, committing and pushing via bash.
Can anyone explain me how is the GUI client helpful in large projects and stuff?8 -
Today we learned:
Don't run a backup integrity check on terabytes of data in multiple jobs your cpu can't handle.
And i cannot abort the process...
Guess i have to go outside, in the cold, brrrr.1 -
!rant
I've always been kinda lazy about backups and such, thinking it wouldn't be so bad, and "I have my most important stuff on Dropbox".
Just now, for some reason one of my hard drives just stopped for a bit, and I couldn't do anything with it anymore. Luckily it went away after restarting my pc, but it scared the shit out of me, as I almost lost 500 gigs worth of music, films, documents, etc...
This made me really think about the whole backup thing, and I'm creating a disk image as I type this. The time that I spend on that will be much less then the time it'll cost to recover everything. Lesson learned ^^'3 -
Decided to try keepass again and the combination of it all nowadays is just (nearly) perfect:
- Keepass2
- KeepassXC Browser extension (the only reason for "nearly" since NatMsg tries to emulate keepassxc but sometimes fails)
- KeePassNatMsg
- Syncthing
- Keepass2Android
There's tons of more things to discover still, but that already gave me a much easier (especially backups wise) and plugin setup than what I had before with bitwarden!
Syncthing also _just works_ (not like it used to be) which makes me all the time question what's wrong with it haha12 -
So ... I'm just watching an anime (Musaigen no Phantom World) ... and this scene isn't related to the main plot. This is the intro of the third episode - the intros of the first two episodes were about the "phantoms", "illusions" ... :)
It starts with a blue screen and the little fairy (it's a phantom btw) said: "When the PC goes crazy, you panic quickly."
In the screenshot he says: "It is important to back up your data somewhere in case of an emergency."
A second screenshot is added in the comments.8 -
The Qt ide lost me three files aka 1 week of work... Obviously it overwrote them with zeros so I cant recover them... Backups??? Well i didnt think of murphys law....3
-
End of the world ?
Github/Bitbucket losing all its data while you are transitioning to a new system with no backups.
I'd rather face a nuclear war.3 -
Created Linux instalation flashdrive on my notebook like thousand times before. Simple dd if=img of=/dev/sdb . Tried installing system from it but somehow doesn't work. And the it hit me. I have both magmetic drive and SSD in my laptop! So insted of flashdrive, I have bootable beging of my SSD where my encrypted lvm used to be :-( Luckilly I lost just EFI, boot, swap, rootfs, few git repositories and ccache.6
-
My Friday feels like a Monday that won't go away. A full weeks progress cleared away by one dumbass that deleted my build, test settings, and backups.
Welcome to another 30 hour weekend.8 -
Man fuuuuuuck, there's nothing more frustrating and scary than fucking up a local git repo. Because you know for a fact you won't be able to restore it
And I even had god damn backups of the .git folder. But reverting leaves me with more files than I started with fuuuck9 -
Was in the middle of working on a game I had been working on for a couple months but had the original copy already corrupt so I was working on bringing it's backup up to the originals point...
Suddenly the power went down mid save, turned the computer on aaaaaaaaand it's corrupt, ended up cancelling the game because I didn't have time to rewrite and build everytbing from scratch again...
Now I don't use hard backups, all gets backed up to the cloud for easy roll back 👍2 -
Anecdote from when I used to be an apprentice:
Setting: Small company, number of employees -> ε, direct superior is the founder and owner, no tech background
Boss: I've looked at this backup directory of the ERP /* why is he even going through that stuff?*/, it looks messy as hell, I want you to tidy that up
Me: Those are incremental backups, I can't just go and delete some of them, the application manages them by itself
Boss: Get it tidy!8 -
Backups is the most important thing, but there is something more important then that. Making sure your actually backing up the files your paying to back up. Now im stuck waiting on 4 2tb drives in raid 6 connected over sata 2 to be recovered because a raid card failed but the drives are still good. Estimated time over 3 days.15
-
My laptop died on Monday. 5 days after it's first full backup in 2 years. I'm almost disappointed it was a power connection issue and not a drive failure3
-
Business Continuity / DR 101...
How could GitLab go down? A deleted directory? What!
A tired sysadmin should not be able to cause this much damage.
Did they have a TESTED dr plan? An untested plan is no plan. An untested plan does not count. An untested plan is an invitation to what occurred.
That the backups did not work does not cut it - sorry GitLab. Thorough testing is required before a disruptive event.
Did they do a thorough risk assessment?
We call this a 'lesson learned' in my BC/DR profession. Everyone please learn by it.
I hope GitLab is ok.2 -
You know that feeling when you realise that you forgot to change database in the dev environment ...
Just love backups sometimes. :)2 -
Rant at myself for being a moron.
Manually tried moving some InnoDB stuff around on a local server and corrupted a load of databases, with no backups since June 28th. Spent all day yesterday trying to recover with no luck 😑
Lesson learned: need to backup databases more regularly. Any good tools?3 -
Thanks to restic and b2 I was finally able to remove my old server backups, feels refreshing and fuse is as always truly magical.
-
I get some error when deleting an azure service so I put a support ticket asking for help. Just as I am about to close my computer for the day I receive an email saying:
"Product team will disable the account xxxxx from backend".
The xxxxx is our subscription number. The subscription that hosts not only that service but also production servers and databases, storage accounts containing backups, etc.
I replied to the email so hopefully disaster is avoided otherwise tomorrow wont be a happy day.6 -
Hello World! Told my son to press "ok" for all questions. So now, I have to look for backups of projects. Not sure id git push
-
When you try and replace the hard drive in your dev machine because the replacement you bought for someone else doesn't work but works for you. You go to turn the computer back on but nothing comes on screen........
-
That moment when you restore a backup from a completely different site into production.
God bless my paranoids and multiple backups. -
A client hired someone to work on a new feature while we were working on something else. The new guy makes huge commits that we don't have the time to read, really.
I merged and deployed my work only to find that the whole database was wiped. Apparently, the new guy pushed some code that reset the database.
I Spent the rest of the day looking through backups trying to restore the database.2 -
Server bios corruption, yaay.
Server external backups, naay.
This happened just before migration to another server. I feel stupid for not having proper backups now, and molested by a dying panda because its less than 6 months ago i got the server. It was used, but still.3 -
Ugh, been debating with a client for an hour about basic backups and security practices and want to tear my hair out. How do you guys deal with stubborn clients?5
-
Question time:
What's the general opinion around here on Authy for 2FA?
I've been down the road of phone wipes and phone swaps before that blow out the Google Auth codes which is nothing but a royal pain in the ass to get access back to all the accounts setup.
Authy having encrypted backups gives me some level of belief they can do what I want them to do, but I figured I would ask around before transferring over since... well that's a pain in the ass too 😂15 -
Just received these hard drive enclosures that I ordered from alibaba.
I am a happy man. Lol suddenly I feel the need to "backup my other backups" 😁😁2 -
I updated all the records about 1000+ because I forgot to write the where clause with the update query and it updated every fucking single row with same values.
~God bless backups :)2 -
😡 When one of your hosting companies (inmotionhosting.com) decides to send you a we're going to freeze your service in 48 hours if you don't remove your site backups...
On a Friday...
The backups were made by their own support staff...
Time to move all properties to AWS! 👍7 -
Maybe a stupid question but I can't seem to google the right words.
In Linux, how do I reference the same device (disk) through reboots? Like, there's no guarantee that /dev/sda1 will be the same device twice, right?
Like, if I have three or four disks and I want one for "backups", how do I choose that disk *every time*?4 -
Someone's guts will be torn out tomorrow and put up on a nice clean razor barbed wire ...
I was wondering what the fucking fuck messed up my brain - till I realized that some dev mixed up the timezone on one of our servers. Dunno how the dev managed it - but the end result was not funny.
Due to the difference in time strings the newer backup had an older timestamp - and vice versa.
Which - when you want to do mass clean up and migration - is a very fucked up thing.
I had to manually check dozens of backups to make sure I got the right ones...
-.- knife goes in, gut goes out. Thx Bart Simpson.8 -
When you are trying to root your Android phone and accidentaly flash the wrong zip file.
https://youtube.com/watch/... -
Mine: not listening to early warning sings that shit won't work. As a result we implemented the wrong technology and had to roll back after a month in production. Lost some customers data, though we had backups, so it was just a delta of a day or so. Still, not pretty, had a rough night writing scripts at 3am to check data validity after.
I will throw in another one from a colleague of mine. He was running some database migrations and ended up pointing the DB migration tool to production by accident. Oops. That one required a restore as well, if I remember correctly. -
>"rm -rf ~/"
>Wonder what the exact name of the file I'm deleting is
>*presses tab*
>*presses enter multiple times*
>accidentally presses "enter" when the choices are finished
>delete entire home directory
>fuck.1 -
That moment when something goes wrong in the server for the first time at 3AM, your last manual backup was 5 hours ago and you stay up until 7AM to rollback and also setup incremental backups every 15 minutes... FML xD15
-
I used to wipe server data before avery update because i had population script for product.
One time i wiped data and had not remembered that we had allowed users to register in the previous release
I now take backups seriously -
Apple just changed their file system to apfs across the board, but no recent documentation on the release. It automaticalky changes from hfs+ when you install the macos 10.12.4 update. In early docs it says that time machine is not supported, but surely they cant kill everyones short term backups?9
-
Client be like:
Hello,
could you please restore our database from today's backup?
At a first glance - nothing out of the ordinary. Daily backups are standard...
Until we get the backed up snapshot running.
MySQLDump is somehow... Stuck. It... Doesn't seem to be doing... Like, anything. For ages. Wtf.
So we check the database. Connect, change scheme and... The commandline tool gets stuck, too. Weird.
So a layer lower, we check the datadir and... ls... After also getting stuck for a bit, lists about 500k files O_o
Yea, dumping a database with roughly ~250k tables is not fun. No wonder it takes ages.8 -
A script to run overnight SQL backups, a colleague updated the DB blindly, corrupted most of the data, when checking the backups there was a typo in the script so they were all 0kb in size!
Luckily I had taken a manual one the day before...1 -
Fuck Salesforce to oblivion and back. I hope all it's buildings, servers and backups fucking burn down. Never has there been anything more frustrating, confusing, over-fucking-complicated and over-fucking-glorified in all history.8
-
So I broke my beloved Fedora Dist. instead of doing a little "sudo chmod -R 754 ./" on a development folder, I did it on root folder ( / )
Now, OS crashed, and I'm getting infinite loops when booting.
But I'm not even mad. I'm impressed :o7 -
Woke up yesterday to find the OS drive failed in my hypervisor.
24 hours later and amazon prime have delivered a new SSD to get back on track.
Thank god for backups, probably going to setup HA now aswell, but great end to a week :(7 -
I now have a pure hatrid for Oculus. I decided to faff around in unity with our Oculus dk, so i went to oculus.com. Downloaded their software and installed it. Then it asked me to restart my pc. So i did. Now my FS is completely corrupted and computer is bricked 😡 (Luckily i do weekly backups) I am never ever trusting Oculus again1
-
"RAID isn't backup"
"RAID is super not backup"
"Don't do RAID, do backups"
B-But I want to do backups... to a backup nas using RAID. No good?13 -
Last day at work: goodbye overnight sessions breeding over some arcane legacy code that blew up in prod or manually restoring dozens of backups because the customer continued to work while systems went down due to power failure.
Colleagues last commit message at that place: It just works (Friday 8pm then shipping the code to prod)2 -
I was thinking about the problems one of our clients faced with the launch of their project the other day, because things were rushed, stuff was omitted and in the end they could not meet the launch date, and I started making a list of hard lessons I learned over the years that would have helped them avoid this situation.
Feel free to add yours in the comments.
- Never deploy on Friday
- Never make infrastructure changes right before a launch
- Always have backups. Always!
- Version control is never optional
- A missed deadline is better than a failed launch
- If everything is urgent, nothing is important
- Fast and cheap, cheap and quality, quality and fast. Only one pair at a time can be achieved
- Never rush the start or the end of a project
- Stability is always better that speed
- Make technical decisions based on the needs of the project two years from now
- Code like you will be the only maintainor of the project two years from now. You probably will...
- Always test before you deploy
- You can never have too many backups (see above)
- Code without documentation is a tool without instructions
- Free or famous does not necessarily mean useful or good
- If you need multiple sentences to explain a method, you should probably refactor
- If your logic is checked beforehand, writing the code becomes way easier
- Never assume you understand a request the first time around. Always follow up and confirm
There are many more that should be on this list, but this is what came to mind now.2 -
I've been running Xubuntu for a while now and decided to try out Ubuntu's latest release.
So I backup my home and workspace directories by compressing them into archives and deciding to move them to another partition.
Long story short, I wiped my partition and did a clean install only to realize a little later that I had moved the backups in only my mind and not on the laptop 😭😭
That is how I lost all my local projects (the ones I hadn't pushed)
Well fuck me😒 -
I think my worst trait is my lack of organization outside a work environment
I spent a few hours cleaning my old hard drives and I freed up 600GB of just duplicate files. Everything from driver backups and progam exe's to simple text documents
Most were in subfolders of a folder named some variation of 'sort_later' :/ oof5 -
Wrote a good backup program, no one cares. I mean, its great if you want to create fast offsite backups! And it is simple to use, and has a pretty dedicated developer working on it all day long (Me)... Well, of course you would want to check it out, so here you go https://github.com/paulkramme/...7
-
I'm running a spin-off and the team is still small. So, I was wondering how a minimal backup system should be. I do not mean to use github, that we already use, I am concerned about the HD of our servers and laptops. Thanks in advance!3
-
>stick holding important data goes bad ("Insert DVD" IT'S A FUCKING FLASH DRIVE)
>no backups as it's a flash drive so my PC never did an auto-backup despite being configured to do so
>might be recoverable
>"short pins 2 and 3 while running tool to reconfigure NAND and controller then recover data from quick format with TestDisk"
*looks at drive*
Well.
Fuck.
it's not even sharp enough to slit my wrists with -
I had a problem with too many backups from our personal data (Photos,videos etc.)
Always I had 1-2 hard drives to backup all important files every time.
Too many duplicates!!
So I created a batch file that for every image-video file type in my backup , will move only one in a new folder, sorted by daytime taken and in a folder of that year, then it renamed all with the datetime of the file.
Now I have a great backup sorted by year in folders since 2003. Just saved me from 2 terabyte duplicates and I have now 600gb sorted backup files!2 -
Python file truncate instead of actually deleting file contents...
there goes a weekend of log backups.. FML -
i accidentally ran the migrations and got lucky it failed. lost the blog table but client had the backups. could have lost the whole database.1
-
Well, if your backups don't include /etc/nginx, make them include that directory. Mine's gone and I'll have to configure that again Friday evening. Woops.5
-
Rant/Question
So I had this friend who has his own company, hosting is part of their business. He gave me a VM to host some websites, test stuff and whatnot. Free. I have quite some important stuff on there (personal, and a few demo sites for clients). No backups of my own, because they do nightly tape backups, and RAID accross physically seperated datacenters. Today, he just shut down my VM - for personal reasons (really personal, nothing to do with his company whatsoever, he hates me lately for something I can't influence). He doesn't say weather or when Ill get the data, and gave me no time to pull it. Can/should I go to the police? I just want my data back, but I don't know if I can do anything as it was free (no contract).
Switzerland, btw.5 -
Posting this rant on behalf of a friend.
I cannot install Mac OS-X Sierra on my top-of-the-line desktop MacPro because Apple has decided they want me to buy a new one, therefore I cannot install iTunes 12.5, therefore I cannot sync my iPhone 6s or iPad Air 2 to my music, backups or apps. $&@# you too, Apple! 😡5 -
Continuing my story from this post:
https://devrant.com/rants/1635258/...
So today I've been working on building a backup for my dad's EOL PC by porting his files to a dropbox backup. He didn't have any backup solution to speak of and was running a taxable business...
I don't know what's more frustrating, my old man not having a backup when he knew he was supposed to or the 11 hours to back up everything on dropbox for him.
Time to make some tea and continue my REACT work with this in the background I suppose. :) -
I have found a DVD with a Windows XP backup file with my late mother's photos on it. However, nothing seems to open the file. I, of course, did a lot of Google searches on how to do this and what it seems to come down to is a need to run the restore on an XP, Windows 7, or Server 2008 machine. There are several legacy ntbackup restore programs out there, and Microsoft seems to still have a page for downloading that, but it relies on the long-deprecated Removable Storage Service that no longer exists on Windows 10. So, a) Microsoft are a bunch of jerks for not supporting restores of legacy backups and b) does anyone have a successful method you've used to get a BKF file to restore? All the things I've tried say the BKF file is corrupted, but how to know for sure when Removable Storage Service isn't present?1
-
Catastrophic Unix failure :(
Full server rebuild ( samba, Apache, cloud) adding back all little tweaks
Thank God for daily backups (full backup restore failed to solve the problem, probably some weird pam issue)
FML 😄 -
Oh my God. It's my last night in Italy and I can't wait for it to end - I'm sleeping in Naples.
I only had to walk 80m from my car to my bnb, but I was so afraid for my dear life I think I have some poopoo in my pantalones.
If I don't survive this night, these of you who know where my backups are, please, continue and finish my work.
What a horrible way to end a vacation.5 -
I'm currently testing live and that includes trying sql injection, i have no backups. So if i forgot to escape string somewhere, I'm fucked. I like to live dangerous :D
Alos, i always test sql injection with "--; DROP ALL TABLES;" Casue... It's a bad idea..?2 -
I can't decide which is worse
I changed the wrong if statement accidentally sent out 15k emails to a clients customers.
Or
Imported a dump of the database instead of take a dump while a colleague was on site training the client on their software.... But found a flaw in our server backups.1 -
I was working for a project with one of the project managers. Despite several discussions, he was not ready to have provisioned for procurement of couple of extra drives for database backups. Also because it's always how they worked, developers were allowed to make changes to the production databases directly.
Since I knew it was going to be burning some day, despite his negligence, I ran a script to take full database backups every night, compress, and remove old backups all to do in the drives we had on server. Sat it automated using scheduler.
One day it happened that one of the junior developers deleted one major table taking whole production down. Next thing you know everyone went crazy. Since I felt bad for the managers and users, I was able to restore database using backup from last night.
You know who jumped in first before senior management to take credit of all this and got some nice kudos..that project manager. Also, you know who got burned..it would not be a rant if I did not got schooled for not following on the wisdom of project manager.
Anyways, we are still not taking database backups (as per project manager) -
And this ladies and gentlemen, is why we have backups.
In the rather stupid event that you completely fuck something up, you can go back to the way things were.
I accidentally rm -rf 'd the wrong shit.
And then my terminal broke. Couldn't access anything.
Had a small backup of all my files.
Quickly ran a restore while some crucial things files were still alive in RAM.
Timeshift is fucking life saver. -
This is a continuation of my previous rant...
I did it! I overcame my anxiety to work on the dev database (don't worry, I made backups). At first I got really anxious and almost panicked at the thought of possibly messing up and procrastinated a few minutes. After the intial anxiety has passed I just did it and it worked. I didn't destroy anything nor did I made any mistakes. One step closer to becoming more confident when working with company assets4 -
A contact of mine asked me to try and recover emails she had deleted from her gmail. I told her if this is the case, I cannot help and she needed to contact google.
Unfortunately, she wouldn't accept this and kept asking me to try, so I reluctantly gave it a shot.
As I thought there was nothing I could do.
I am now half expecting her to ask me to try and access googles backups.
IM A GAMES DEVELOPMENT STUDENT, NOT MR ROBOT!1 -
Yesterday I took the evening to set up a backup server on my home NAS, so I could finally backup my dualboot laptop. Today I came home from work, boot up the laptop to configure the clients.... This happen, fucking black screen and doesn't even boot! Fuck fuck fuuuuuuck!!!4
-
At college, second year, basic CS for that school. The teacher calls me to her office, and asked me if I had any backup of my work, because the school computer I used, had crashed and the school didn't have backup of it.
2 years of school material, lost. So the teacher and school director had to vouch for me. Still got best grade in glass. -
Note to self.. Check how your backup restore works before actually needing it...
Coworker got ransomware to his computer via targeted attack and managed to encrypt about 6000 files on Google Drive share... Which I have backed up. However there are a total of 100k files so total restore is not an option and with 60 users updating things can't do point in time restore either... And thanks to the backup softwares buggy cmd line interface I can't create command line script to restore the files one by one... So in the end I most likely need to restore via sluggish gui one by one...3 -
Always have a roll forward plan, backups, and a site B. Especially if you think it is a non critical system.
-
Jenkins! Damn you, our possibly corrupted OS underlying Jenkins! Damn you, our failed Jenkins backups! Damn you, me for not knowing better.
-
What's your favorite vps hoster?
I'm currently using scaleway and love it, but recently learned that they offer no protection against data loss.
So I'm looking for an alternative for a project in production that has automatic backups as well as unmetered bandwidth.7 -
After a month of loving git, I finally got into an irreversible git mess yesterday. Spent all night rewriting last two days of code. I feel like a real programmer 😋
Seriously though, I'm gonna take backups a lot more frequently now onwards.2 -
So I just got the cyber security pack on humblebundle... $15 for a year of PIA, a year of spider oak one cloud backups and a year of Dashlane are the notable ones (I’ll give away the antivirus ones for free since I don’t have windows).
But that wasn’t the awesomest part...
I installed Dashlane and after transferring all my stuff over from LastPass, I went to delete my LastPass
Dashlane autofilled the username...
It’s like so subtly aggressive in an unintentional way. Honestly this password manager Battle Royale is totally worth the $15 regardless.13 -
Been asking the devops guy to schedule database backups for some of our side services for weeks! Just waiting for the day it all goes to hell and have no disaster recovery plan to fall back on.
-
Just a note to everyone. Please make sure to test your script before putting it on crontab and soft-deleting all backups. They are restored now but seriously...4
-
I use cloud storage as one of my 3 backups for my gpg master key only protected by the password cause i don't want to have to restore from paper if hell freezes over.
-
So until now the default env var User directory paths for Windows were all located under %userProfile%. To my surprise:
cd %userProfile%\Desktop
no longer works. Indeed, when you are even just signed in to OneDrive (which is the default, even if you disabled backups!), these retards decided it was a good idea to move all the standard library folders one level up to %userProfile%\OneDrive\ instead.
And the worst is that the locations continue to be swapped when you enable/ disable OneDrive.. WTF Microsoft7 -
Today was a painful day when I realized that I need to backup my nginx configs like I backup my actual data. 20 minutes of downtime turned into an afternoon when I accidentally deleted the nginx config backups on my server. It's been... let's say fun.4
-
Normal people : Save thier work regulary.
Me :
Oh no matter, notepadd++ saves opens files somewhere, i'm good with that.
There are important lohins, passwords, some temp stuf and work in progress for something, there are backups and information needed.8 -
Wanted to delete cache for a project. By mistake I deleted cache and vital settings.
The good news is that I make weekly backups, the bad news is that my latest backup is 4500 miles away from here 😓 -
So I finally got a rant to tell, about me myself and I. Were working on my web host (personal gladly) and was trying to get ACME working without root access. I messed up and somehow got a folder named “~”, in a directory. I thought “well that folder is unnecessary” and I ran “rm -rf ~”. The moment I pressed “enter”, I realized what could’ve happened, and it did happen. My whole web-root gone. No backups. Just a big facepalm on my forehead ...
Take lesson, fix backups...4 -
I had a 1Tb external hard drive on the corner of desk (My fault, i know, but at that time i didn't have a lot of space), i used it to keep mostly unimportant things like game files, VMs, movies and stuff like that. Once i was streaming a movie from the pc to the tv in the other room, suddently the tv disconnected, i went to the pc room to check, and i found out that the evil monster that lived in my house (the cat) dropped it off the desk.
The hard disk died and brought all its files with it, luckly i had backups for most of the important files, but i had to download again around 300GB of stuff.... with my slow internet. -
Yeah, sure.. I'll configure your DNS & mail server.. while I'm at it, I'll also optimise your db settings & configure backups..and don't forget LDAP & group policies!! Sure, no probs!! :/4
-
This one time last year a colleague found out that some data went missing and suggested to recover the data from a backup. When trying to create a new database instance in the Google Cloud Platform (if everything works it's amazing!) it failed.
Not knowing why this happened, I tried to revert that backup to the production database, after creating a backup using the GCP. Needless to say that failed as well, resulting in a corrupted database instance where I couldn't access the created backups anymore.
This all went at around 10pm and the only users of our product are currently in the same timezone and use it from around 7.30AM until 6PM so no one besides our team knew the server was down.
After a long night chatting Google's support team the database was successfully recovered and the only harm done was sleep depravation for me and a colleague.
Apparently there was a bug in the GCP. It was resolved in two hours and the last time a breaking bug was in that piece was more than seventy days earlier.
I did at least learn to create local backups as well, instead of relying on the tools of the same product...
Best: the moment I saw the corrupted database spin up again and not losing my job because of it. -
Saturday morning 9:30. Alright, let's crack this case. Automated PG backups of DB in a docker swarm attempt 5.
-
God, these people...
Little backstory. I'm making an training application and we have a MySQL database set up where some elements of the training are configured. This is so learning experts can easily change some aspects of the training without programmer's help.
Meanwhile, I'm also in the middle of a server migration, because our current server is running a lot of deprecated software and is in dire need of replacement.
This is going pretty slowly, though, because of other, high-priority, work that keeps being shoved my way.
Now, someone accidentally deletes a bunch of data from one of the schemas. No big deal in my book, the training is still in development and we have nightly backups of the database.
So I shoot a support ticket to the hosting provider and ask them to restore a specific schema, telling them to restore the image to some other machine and dump the tables in an MySQL file so I can restore it that way.
I also told them to get the backup of the OLD server, not the NEW one we're still migrating to.
About an hour later, I get a message that they dumped the schema's files in a Temp folder on the D drive. So I RDP to the server to check and... The files aren't there. Just before writing a response asking where the file is, I remembered the server I was migrating to and checked that server, and there were the files.
I had already migrated part of our databases and was testing compatibility before I moved to something else.
The hosting provider just dumped the files of the wrong server, despite me telling them exactly which server to use.
This is not the first time this hosting provider has let me down...
I'm really considering jumping to another if they keep doing this... -
Hey guys.
So, where do you guys store your passwords?
It's getting hard to keep track of so many logins and passwords now that I have the time to learn, try new stuff, meddle with VPS and shit and I can't keep track of everything.
Ps: must save somewhere online (or at least backups) and be multi platform (windows + Linux + Android9 -
Accidentally deleting files for one of our internal web servers because the naming of the directory looked like a duplicate of another directory. Thank goodness for backups.
-
I guess there was some time where The Doctor also worked in it.
Because its so true as well for it. 😂2 -
FUCK.
I've corrupted 100 gbs of live data...
I'm hoping we will pull through with backups (3rd party backup software for SharePoint)1 -
Do you think you have to go to school for that? No no no. Some definition from a book won't help you, nor a person who haven't seen the real code for some time.
Sit and write. Anything! Still nothing? Printf("Hello World"); make conditions, think big, break the shit out of it and you'll learn along the way.
And do backups of git on remote. Two at least! -
So.....
Cassandra vm had a crash yesterday...
2 nodes with rep factor 1. (FML)
One node wouldnt start... Eventually found out one of the commit replays had an exception (the one at the time of the crash).
Boss trying to push me towards a fix all this time which was:
"Let's delete the vm and have Cassandra running on one vm"
There are not we enough curses in the world.
🖕🖕🖕🖕🖕🖕🖕🖕🖕🖕🖕
P.S. there are no backups. -
tldr: Deleted Win10, turned out for better
---------
**This happened a few months ago**
---------
So one day I decide I have had enough of Windows 10 and wanted to go back to Linux (A long time ago I had dual booted Ubuntu, but messed it up changing video drivers). So I create a Mint installation USB and get to work. I boot up the installation and delete the old partitions from the Ubuntu install. I install Mint and boot it up, everything works fine and dandy! I decide I want to get back on Windows to get back a few files that I wanted copies over. I turn off the computer and *try* to boot up Windows. I get an error message that I am UNABLE to boot. WHAT! After further checking, I realize that I had deleted the MBR partition of Windows. Pretty sure I could remake it if I tried hard enough, but I am starting to realize that it feels good to be totally MS independent! Now I am using all open-source software available to Linux and have no need for Windows. I do miss some of the games though...
PS: No files were lost due to backups. Save Lives, Do Backups! -
!dev but a parable
I worked at a Walmart Photo Lab with a Fujifilm photo processor. I had a guy ask for his pictures but they weren’t printed, I could see his order but there was no “payload” ( think PO header with no PO lines). He said he ordered 600+ pictures off his SD card, then blew them away because they were ordered.
As I had no physical pictures, there was nothing I could do but say “sorry”. He was mad, but there was nothing I could do.
Moral of the story, verify backups before wiping the system. -
Lots of thumb drives. My laptop used to not have much storage and most of my files would be on those thumb drives.
My first one was 8GB, then 16, then 32, 64, 128, now 256.
Each time I got a new one I would copy the old files to it, kinda like these crabs https://youtube.com/watch/...
All of them are in a little box on my desk right now, I use the old ones for backups. I replaced the laptop's hard drive a few months ago so now I'm less dependent on thumb drives :)2 -
Has anyone ever figured out why the fuck Android reboots seemingly out of nowhere at random times?
Is it kernel panics? Is it some shitty bug that has been plaguing this cursed OS since its inception? [sidenote: boy that was a mouthful of 's'es]
Or are we already at the mercy of the Big Brother, and someone at the controls likes to play random pranks on us when they're bored?
Thinking of switching to LineageOS more and more, but I'm kinda worried about resetting my phone since I've never done full backups/restores and I have no experience in the matter...7 -
I work in a repair shop, I have 300+ sticks of RAM laying around, from DDR to DDR3 (DDR3 of 4+ GB and DDR4 are either good for replacement on new computers or are sold immediately so don't count them as laying).
Also I have 200+ hard drives, IDE, SATA, SAS, 2.5, 3.5, 20 GB to 1 TB. Lots of them.
What can I do with all this crap? Not enough matching CPU and MB to make a working system (unless I make a very obsolete one but there's no point in doing so). I also am using single hard drives for backups (only 500+ GB SATA-3 though) so I'm mostly concerned with all that old ram. What can I do with them??8 -
I learned over this weekend that there are no good tape backup systems for Linux. Oh sure, there are a couple of open source projects like Bacula and AMANDA, but they're both a bit too much on the .conf file hell side for me. And fuck literally everything about .tar scripts.
And then you've got things like Backup Exec that, while having its own problems like not being hostable on a Linux machine, will talk to a Linux machine and its connected tape devices with very little hassle.
Linux people: UX is important! Licenses for expensive software are often cheaper than teaching people how to use obtuse systems!1 -
So I was wondering... What's the worst burn you've seen from an unknown angry dev that you had to clean up?
A recent one of mine was a client in need with nuked hosting, nuked domain records, no backups, no access to any accounts and the business set to permanently closed on Google.
I thought that last one was a nice touch!1 -
I have a little vserver with the possibility to backup to my free Dropbox. 😎. I host nodejs stuff on it not much fife little apps. Guess what?
Yep my Dropbox running out of space. I like nodejs 😁4 -
To have some Backups on your NAS in the Office is awesome... to have no Access from Remote Location if you need it...#$/$##!
-
Well, I crashed my work MacBook attempting to update to macOS Sierra. Good thing I had backups of some criticism projects I've been working on.5
-
I'm planning to switch from ownCloud to Nextcloud in the next weeks. Does anyone have experience with that or maybe some advice? Aside from creating Backups.6
-
FEAR OF DATA LOSS
Resolution => backupS
1: external drive (or NAS)
2: cloud storage (maybe multiple services)
3: git repositories
After all these backups you are kind of demigod of data recovery...8 -
Anyone know of a good docker backup tool?
I'm working with fairly limited space here so Im looking for a tool to allow me to backup and restore my docker instance without storing easily recreatable data.
That means that what I want to backup are:
- Container specs (inspections or the like)
- Contents of persistent, non-nfs volumes
Since the image and the contents of my nfs volumes are stored elsewhere, and my space is limited, I decided not to back them up. Same for non-persistent (unnamed) volumes since they mostly contain stuff that you don't want to recreate on every container update or recreation but can easily be recreated if needed.
The hope is that this approach should give me a pretty slim backup while still preserving everything I need to recreate my whole docker instance.
Thanks in advance!11 -
So yes, I know that I should have more paid more attention when I cleared the production artifacts instead of my test artifacts. But no access control and the last backup is from september? Sorry, but I don't think that this isn't your fault, too.
-
I've stumbled upon some sources (mostly C/C++ and Pascal) during reorganizing backups in home LAN from 25+ years ago. Hell, I've used to be better coder then (code is more optimized and cleaner).
Perhaps it is just hardware (much, much more powerful) and choice of languages/libraries/frameworks I use nowadays?!3 -
How do you guys manage your Dotfiles ?
I'm searching for a better way than just including them into my backups.5 -
When you unknowingly/accidentally/inadvertently delete something someone was working on for a long time and they don’t tell you until several months later when all the backups are long rotated out. No way to fix it and nothing left to do but accept blame and sanctions and work to regain lost trust. Kill me now.4
-
So I have this habit of copying all my family pics and kids videos onto portable hard disks. Have a 500GB Western Digital since 2012 and another WD 1TB since 2016.
Had one portable HDD failure before that back in 2010, but that contained only old projects code {when I didn't know git} .
So any advice you guys have for me on managing backups of these life memories? I mean I don't trust cloud storage - Google Drive, DropBox etc. And don't want any 3rd party poking into my stuff. That's why these items go straight from Camera to HDD.
What should I do to prepare for another failure? And is there any kind of RAID available in the form of portable solution?
Is it a good idea to change HDD every 5 years or so?10 -
I'm easily a Digital Oceans fans, though I have heard horror stories, so I might set up a system to do regular backups.
I'm considering migrating my current server to something FreeBSD based, so I can easily do ZFS snapshots, and even code on my machine at home and just send the jail as a snapshot. Like docker, but different.5 -
Fuck my life, my morning was very variable it went from "in 4 day's the DB server domain will expire and will be screwed" (was created by a collaborator before my time in the company and not is going dark) to "oh here is the server and there is even daily backups" so it ended well but it was a hell of a journey.
-
Had a boss that was not going to let me keep our original data around as a backup, because they said "if you're that convinced that we need the backup around then you must not write very good software". In short, their way of saying I must be a shit developer if I want backups.
Nah bro we keep backups because there's bound to be fuckups, I'm trying to plan, not play petty mind games and stroke your ego. -
Today I was going to wipe an server used for testing purposes, I thought that all vms are just tests that has been left over from restored backups.
Was in the raid controller configuration ready to format the drives an couple of menu navigation away, a colleague came looking for me and said an website was not working, strange...
Turns out that one VM responsible for hosting our internal websites was on that machine -
1. Windows domains as user@domain
2. Starting tape backups at 13:37, realizing they need about 5 hours and all company servers run on ~5% speed for others
3. Repeatedly opening and closing devRant multiple times a minute realizing it has been open currently
4. accidentally executing "apt-get update && apt-get update"
5. Trying every earlier password if the current windows domain password timeouted until I come to an not yet used one. -
I hate when clients think they're always right.
Yesterday this client showed up saying that he had an emergency on computer, because after an update all icons turned white. When we told he the situation and that all data was lost, he begged to retrieve all the info because he needs it to work.
He was affected by ransomware, something like Fantom, and not only all the files are encrypted but also the backups.9 -
Thought it had been a while since my last Arch redo. Now the fsck output is hundreds of pages long and I'm grateful for my backups, and all suspiciously occuring just seconds after a full upgrade. I guess hardware failure is a possibility, but the smart status on the drive says it's perfect and dozens of retrospective self tests didn't reveal any issues. RAM passed multiple tests as well. Oh well, not like I haven't reinstalled before.
-
I was copying a couple of folders onto my external hard drive when my laptop crashed.
Now the whole drive needs formatting...
I have years and years of photos and files on it. I have some stuff backed up but I don't want to lose over a tb of data if there's any way to recover it, I can't refilm my baby brother's first steps.
Google's answers so far have been unhelpful or risky, can anyone give me any advice?(please don't say make more backups)18 -
FUCKING STACKOVERFLOW ASSHOLES.
This guy answered my question on security.stackexchange.com with an answer showing he clearly doesn’t understand that I’m asking if my RAID1 setup constitutes an appropriate backup. (I know that sounds stupid, I can post a link if anyone wants to see the specific circumstances).
I FUCKING KNOW RAID ISNT A BACKUP BUT THIS GUY IS LIKE “RAID 1, or mirroring, is definately [sic] considered a backup in corp IT”
Go suck a dick.9 -
So I just spent 8 hours migrating our git projects from bitbucket to gitlab because SOMEONE thought backups were being done nightly without ever actually checking. Of course the only backups to be found were well over a year old and the fucking bit bucket licence expired ao migration was entirely fucking manual... CHECK YOUR FUCKING BACKUPS, FUUUCCCCKKK!!!!! At least have the common courtesy of putting something in place to report on failing backup procedures.
Oh and another thing: FUCK YOU ATLASSIAN! RIGHT UP THE ASSE WITH A RUSTY, RABIES RIDDEN, AIDS INDUCING PITCHFORK SIDEWAYS! Who the flying fuck names their repos numbers? Thanks for nothing you mind numbingly incompotent apes...
On a cheerier note, how's everyones day been?2 -
Wondering if I should install adb and android dev drivers on my dad's laptop just so I can reflash and upgrade OpenGApps, LOS.
The locations services didn't seem to be working well, seems it may not be using the GPS,. just wifi...
I don't have all the backups, stock images I have at home either and not sure I want him to see me fucking up my phone...
Convo I had last time:
Me: Oh I bricked my phone again, for now you can reach me by email
Dad: wtf? Why?
Me: well it's complicated... Wasnt working and so I wanted to reflash and upgrade everything but ...
Dad: stop buying shitty phones
Me: ....3 -
> Get sent to local client that manages most services on prem themselves
> We just deliver the software and setup instructions, client is self-proclaimed "technical enough" to handle the rest
> Never had issues with them, client for about 1,5year, we assume they are indeed technical enough
> Local client needs me for some help with their "backup solution"
> Cron job that dd's entire disk every week to external ssd.
> External ssd finally caved in after what was most likely years of torture
> Has nothing even remotely to do with our software (which has built-in backups, which they apparently don't use)
> I get scolded and screamed at when I say not our problem
Fml2 -
Not having kept sturdier backups of my first projects to show them to trainees to give them more trust
-
Dear Mongodb, I created the clusters in your service because you created Mongodb. I also subscribed to the "Premium" to get better service.
I get it, my card didn't have enough balance for the last 3 months but you could just convert my account to "Free".
How could you delete the cluster? You morons deleted all the data of my app of 1.5 years. You even deleted all the backups! WTF!
What's the point of buying premium service if that makes you lose the data? Fuck you!6 -
I think I have configuphobia.
When you need to setup configurations for like anything, it's always super loosely coupled and can break when you even breathe on it.
Database table columns? Configured once.
Authorization management? Create a user and configure the password and username in the application.
Backups? Configure the network path to backup to.
All these things are so EASY to break!
Maybe I'm overcautious, but I really dislike it.
There are ways around it of course, like documentation and automation, but it's all so much work. And even then it's still loosely coupled.
What do you all do to keep your configs working without getting nightmares?3 -
So in Seahorse (the Gnome secret manager) deleting the OpenSSH key doesn't just remove an identity from agent, it actually deletes the keyfile.
I should've treated that scary confirmation message more seriously.
Also, my obsessive full disk backups every Monday are totally worth the time.2 -
Finally got my boss to allow us to use git so we have a source control for not just our applications but our websites. He told me he still won't use it. Should I make a copy of the sites then take it down and see how long it takes them to recover?
Also, the only backup of the websites is in the root directory of each website1 -
I go on vacation from work for 3 weeks at the end of this week, the longest I'll have taken at once in at least 10 years..
Finding it REALLY hard to a) focus on work now (yay vacation brain).. b) trust my coworkers to not crash the system, burn the backups and just generally bugger everything up while I'm gone. Aaarrrggghhhh4 -
When I was an apprentice in a small company, ...
I had the order to set up Subversion on our machine with a fresh installation of Linux Ubuntu. The order included to create only a single repository for all projects we were working on. He totally missed the point how version control works. In his opinion it is just a place to store backups, and nothing more.2 -
Upgrading from Crashplan Home to Pro and realize they don't actually migrate the already backed up data... Wtf? Nice going ya dopes.2
-
Matomo, the free web analytics tool formerly known as Piwik, does not display referring search keywords (anymore?) without purchasing an add-on, which makes it less valuable than the good old webalizer. I should grab my old backups from 2001 and find a Perl script that crawls Apache server logs. Why must digital progress always mean Verschlimmbesserung?
> Use Search Keywords Performance to see all keywords behind 'keyword not defined'. All keywords searched by your users on Google, Bing and other search engines will be listed1 -
Any suggestions on android data recovery ??
The device is not rooted and there weren't any backups.
I have already tested different paid (cracked) software on another device for testing purpose but none of them work.
Send Help!!7 -
I can sync saves to and from the cloud on my Xbox One (after a long support session due to some weird shit but w/e it's fixed now) but I can't copy them to/from USB or internal storage, so I can't back them up manually so we have backups after we lose our good internet and switch to basically mobile data at non-LTE 4G speeds at anywhere from 100/500GB a month for 4 people (we don't get to know how much we get until we go over either!)
fucking kill me3 -
I don't know if this counts but wrote a generator that replaced a shitty linq to sql dal to use our system so I didn't have to mess with a web app I'd written. In place replacement with a few methods that made the other transaction lock field updates and calls etc
Most risky I can think of
Everything else was data migrations but there were always backups1 -
That time when you first learn command line to remove a directory and end up deleting the entire corporate intranet.
Thankfully there were backups.
Only learned afterwards they had just started doing back ups the day before.
(face palm)1