Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple APILearn More
Search - "data science"
Buzzword dictionary to deal with annoying clients:
Dark web—Onion service
Data science—statistics done by nonstatisticians
Was originally hired for 3 months.
Just finished the project 2 weeks ago, after 1.5 years.
I fucking hate data science now.8
Recipe for a Great Programmer:
-Books for a computer science curriculum from a top university
1. Cover computer science books with lighter fluid
2. Light books on fire
3. Use flames to cook an energy-rich meal for the thousands of hours ahead
4. Pick an IDE
5. Choose a project beyond current capabilities. Good ways to push boundaries:
- Unfamiliar domain (e.g. large scale data processing, UI programming, high performance computing, games)
- Exotic programming language
- Larger in scope than any project before
6. Shut up about your IDE
7. Attempt to build
8. Stop procrastinating on Hacker News
9. Re-attempt to build
10. Squeeze stress ball and scream into pillow as necessary to keep sanity
- Paste stack traces into Google
- Find appropriate mailing list to get guidance
- Realize that real learning happens when you are stuck, uncomfortable, and/or frustrated
- Seek out books, classes, or other resources AFTER you have a good understanding of your deficiencies
11. Repeat #4 to #10 for at least 10 years
12. Results guaranteed! (to the same extent static types guarantee bug-free programs)
Facebook: "Our facial recognition automatically tags people in pictures."
Tesla: "Our deep learning algorithm drives cars by itself."
Andrew Ng: "I predict patients' likelihood of dying with 99% accuracy."
Google: "You know one of our algorithms is going to pass the Turing test very soon."
Wall Street: "We use satellite images to predict stock prices based how filled car parks of specific stores are."
The remaining majority of data sciencists: "We overfit linear models."2
A tool I built for my past company just got nominated for a European Data Science and AI award!!!
I'm over the moon that something I built is up for such an award. Be early next month before winners are announced. Oh and given I don't work there anymore, how I was told about it is a REALLY funny story .... I wasn't.
Saw a Linkedin post from my ex-manager congratulating the company and the org for great work done. He/They just forgot to mention the fact that me and another ex-employee did everything, left it practically finished and completely changed the direction of the project within the first month as their plans made no sense.
Professor essentially doing a dance to show data visualisation:
“Hey pay attention! I’m trading my dignity for your education”4
Yesterday i updated my LinkedIn title to Data scientist.
Today morning i got 3 phone calls for job offers.8
Two years ago I moved to Dublin with my wife (we met on tour while we were both working in music) as visa laws in the UK didn’t allow me to support the visa of a Russian national on a freelance artists salary.
After we came to Dublin I was playing a lot to pay rent (major rental crisis here), I play(ed) Double Bass which is a physically intensive instrument and through overworking caused a long term injury to my forearm which prevents me playing.
Luckily my wife was able to start working in Community Operations for the big tech companies here (not an amazing job and I want her to be able to stop).
Anyway, I was a bit stuck with what step to take next as my entire career had been driven by the passion to master an art that I was very committed to. It gave me joy and meaning.
I was working as hard as I could with a clear vision but no clear path available to get there, then by chance the opportunity came to study a Higher Diploma qualification in Data Science/Analysis (I have some experience handling music licensing for tech startups and an MA with components in music analysis, which I spun into a narrative). Seemed like a ‘smart’ thing to do to do pick up a ‘respectable’ qualification, if I can’t play any more.
The programme had a strong programming element and I really enjoyed that part. The heavy statistics/algebra element was difficult but as my Python programming improved, I was able to write and utilise codebase to streamline the work, and I started to pull ahead of the class. I put in more and more time to programming and studied personally far beyond the requirements of the programme (scored some of the highest academic grades I’ve ever achieved). I picked up a confident level of Bash, SQL, Cypher (Neo4j), proficiency with libraries like pandas, scikit-learn as well as R things like ggplot. I’m almost at the end of the course now and I’m currently lecturing evening classes at the university as a paid professional, teaching Graph Database theory and implementation of Neo4j using Python. I’m co-writing a thesis on Machine Learning in The Creative Process (with faculty members) to be published by the institute. My confidence in programming grew and grew and with that platform to lift me, I pulled away from the class further and further.
I felt lost for a while, but I’ve found my new passion. I feel the drive to master the craft, the desire to create, to refine and to explore.
I’m going to write a Thesis with a strong focus on programmatic implementation and then try and take a programming related position and build from there. I’m excited to become a professional in this field. It might take time and not be easy, but I’ve already mastered one craft in life to the highest levels of expertise (and tutored it for almost 10 years). I’m 30 now and no expert (yet), but am well beyond beginner. I know how to learn and self study effectively.
The future is exciting and I’ve discovered my new art! (I’m also performing live these days with ‘TidalCycles’! (Haskell pattern syntax for music performance).
Hey all! I’m new on devRant!12
Dropped my youngest off at the childminder today and her husband asked me what I'm doing for a job now
.. Explained its security and data science... His reply was to ask if I can setup a printer....5
Guidance counselor at school: so what field do you want to go into?
Me: computer science
GC: what does that entail?
GC: that's like super repetitive, right? You're a smart kid don't do that
In my head: no you mf dingle-dong. That's the job that will take your job away from you in the next 5 years
Ffs, why do people think coding and entering data into Excel are the same things?6
I just released a tiny game for iPhone!
It's basically an attempt to mix 'Heroes of Might & Magic' and mtg.
In the screenshot my terminal says 'helloworld.cpp'. That's right, this is my first c++ program and I don't care how crappy you think this game is, I'm super proud of myself!
I've always worked in data science where managers assume I know how to code because there's text on my screen and I can query and wrangle data, but I actually didn't know what a class was until like 3 years into my job.
Making this game was my attempt to really evolve myself away from just statistics / data transforms into actual programming. It took me forever but I'm really happy I did it
It was brutal at first using C++ instead of R/Python that data science people usually use, but now I start to wonder why it isn't more popular. Everything is so insanely fast. You really get a better idea of what your computer is actually doing instead of just standing on engineers' shoulders. It's great.
After the game was 90% finished (LOL) I started using Swift and Spritekit to get the visuals on the screen and working on iPhone. That was less fun. I didn't understand how to use xCode at all or how to keep writing tests, so I stopped doing TDD because I was '90% done anyway' and 'surely I'll figure out how to do basic debugging'. I'll know better next time...22
I've dreamed of learning business intelligence and handling big data.
So I went to an university info event today for "MAS Data Science".
Everything's sounded great. Finding insights out of complex datasets, check! Great possibilities and salery.
Only after an hour they've explained that the main focus of this course is on leading a library, museum or an archive. 😟 huh why? WTF?
Turns out, they've relabled their librarian education course to Data science for getting peoples attention.
Hey you cocksuckers! I want my 2 hours of wasted life time back!
Fuck this "english title whitewashing"4
My neighbor(He is 14 I think) pitched this to me and wanted advice since he was going try to participate in the Google science fair.
Him:"A robot that gives you medical advice. You just tell it your symptoms and voila! You've got your diagnosis. No doctor required."
Me: "How are you going to decide what disease the user has?"
Him:" I'm just going to write an if-else ladder statement. I've already got some of the data from this site called WebMD. It's amazing."
Me: "Go with something simple. What you're suggesting won't work out."
He told me I didn't have "Vision".
His ditched his project last week.19
M - Me
F - Family member
F: So you study computer science... Could you recover my Gmail login data? I don't remember my email address, password or security question. (7th request to me like that from the same person, they don't bother to write down the recovered pw)
M: I can't do it if I don't know any of the above
F: Wow, I thought you're a good student... Could you at least create a new account for me?
M: But you won't even remember the new... [gets interrupted]
F: So, are you going to talk trash or get to work? You would have already been 50% done
PLEASE I'M SO TIRED OF IT. HOW DO I DEAL WITH THESE OTHER THAN TELLING THEM WHAT I THINK ABOUT THEM. I SEEK HELP12
We just did a massive update to our prod db environment that would implicate damn near all system in our servers....on a friday.
Luckily for us, our DB is a badass rockstar mfking hero that was planning this shit for a little over a year with the assistance of yours truly as backup following the man's lead...and even then I didn't do SHIT
My boy did great, tested everything and the switch was effortless, fast (considering that it went on during working hours) and painless.
I salute my mfking dude, if i make my own company I am stealing this mfker. Homie speaks in SQL, homie was prolly there when SQL was invented and was already speaking in sql before shit was even set in spec, homie can take a glance at a huge db and already cast his opinion before looking at the design and architecture, homie was Data Science before data science was a thing.
Homie is my man crush on the number one spot putting mfking henry cavill on second place.
Homie wakes up and pisses greatness.
Homie is the man. Hope yall have the same mfking homie as I do5
So my first job is also my current one. I am a computer science student and for my course we had to do a project for an actual client. The client was a consultancy company and after working my ass off, their software development partner decided to hire me and a classmate.
The company is pretty small (we are now with the 6 of us) and the general attitude is very nice. I've only been working there for a few weeks and I feel very welcome. The work isn't too hard (mainly web development with geographic features/data).
In rough lines the stack always consists of a Java Rest API and an Angular frontend that retrieved the data from the API.
So far I have learned a ton and I am really happy that I have this opportunity. Lunch is provided and we always eat together, we crack jokes, have fun, play games in the break. Coffee machine next to my desk. I'd love to work here all my life :d
Since I'm still in school I can't go to the office every day. Instead I am at the office every Monday and on other days I try to work from school or home.2
$50,000+ Computer Science fucking diploma, yet here I am on a Sunday evening doing data entry coz there is no one else to do it!11
"we use machine learning to ..."
Ffs you're interviewing a developer, not pitching to a investor. We know how much machine learning you use.7
My dream was shattered!!
I joined a new company. I graduated last 2 months before and joined as data analyst.
So I was dreaming to work on some awesome research projects and all, but it was just another dream...people here don't work on any sort of data analytics instead the data science team uses regex and all to extract things and say they are building models.
Many co-workers are good and help me, but the boss. He left all the annoying works to me and the release is in next month...
"BRUH I JUST JOINED YOUR COMPANY!!!"
Then after some days he gave me more task, when he found that one task was super easy(i mean it was just to extract things using bs4 and selenium, hardly will take an hour) to do then he took that himself and in the next meeting said he did that work and it was super difficult!!!
Data science here to senior members is just for loop!! I dont even know why I joined this firm
Ahhh!!! I want to scream!!!11
I attended a data science meetup recently. There were many suits walking around the corridors because of some startup night taking place at the same time.
After some time a guy appeared infront of me, telling me he was afraid at first that this was a meetup for suits only. Until he saw all the dev and rock stickers on my notebook. He was reliefed that there was some nerd at least.
He asked what I was doing so I told him about my startup about optimization of heat generation plants jada jada. I asked him back.
He replied, "Well, I'm also part of some small startup. Among the things we develop processors and stuff. It's called Intel."
Well dude, that was nicely played. I had a lot of fun that evening.5
What sort of fucking asshole decided to name it "data science"? We already have a "science of studying data", it's called Statistics...8
I'm new here and I want to introduce myself and meet you too.
My name is Mariana, I'm 21 years old and I live in Brasilia, capital of Brazil.
I'm a beginer in the world of development and I joined on this community to know more about this world. I am currently studying js, react and react native, but I am passionate about database, in the future I want to work with data science.
And you? Feel free to introduce yourself too! :)17
Computer science students and data scientists rejoice, "All algorithms" implemented in many common languages:
Just because you can learn HTML in a day doesn’t mean that you don’t need a degree.
It’s important to understand the roots and fundamentals of computer science even if you won’t use that knowledge day to day.
It changes your perspective on programming once you learn what actually goes on under the hood, and makes you think twice about the impact of what you write.
It’s relatively easy to get a programming job without a degree nowadays, but it often leads to web developers claiming that degrees aren’t important to their web apps.
There is much more than just the web to computer science, and that’s something to always keep in mind.11
It was my first ever hackathon. Initially, I registered with my friend who is a non coder but want to experience the thrill of joining a hackathon. But when we arrived at the event, someone older than us was added to our team because he was solo at that time. Eventually, this old guy (not too old, around his 20s) ( and let’s call him A) and I got close.
We chose the problem where one is tasked to create an ML model that can predict the phenotype of a plant based on genotypic data. Before the event, I didn’t have any background in machine learning, but A was so kind to teach me.
I learned key terms in ML, was able to train different models, and we ended up using my models as the final product. Though the highest accuracy I got for one of my model was 52%, but it didn’t discouraged me.
We didn’t won, however. But it was a great first time experience for me.
Also, he gave me an idea in pitching, because he was also taking MS in Data Science ( I think ) and he had a great background in sales as well, so yeah I got that too.2
Most kids just want to code. So they see "Computer Science" and think "How to be a hacker in 6 weeks". Then they face some super simple algebra and freak out, eventually flunking out with the excuse that "uni only presents overtly theoretical shit nobody ever uses in real life".
They could hardly be more wrong, of course. Ignore calculus and complexity theory and you will max out on efficiency soon enough. Skip operating systems, compilers and language theory and you can only ever aspire to be a script kiddie.
You can't become a "data scientist" without statistics. And you can never grow to be even a mediocre one without solid basic research and physics training.
Hack, I've optimized literal millions of dollars out of cloud expenses by choosing the best processors for my stack, and weeks later got myself schooled (on devRant, of all places!) over my ignorance of their inner workings. And I have a MSc degree. Learning never stops.
So, to improve CS experience in uni? Tear down students expectations, and boil out the "I just wanna code!" kiddies to boot camps. Some of them will be back to learn the science. The rest will peak at age 33.17
Literally anything but work with computers, I think. They ask my brother to fix anything technical in the house and ignore it when he fails. They haven't been able to watch TV in six months. When I suggest that my (well-intentioned but mostly nonverbal) sibling probably shouldn't go into development, they tell me I don't know my own job. I suspect they're convinced I do graphic design.
I write C++ applications that run physical simulations and sometimes train AI models for pattern recognition and highlighting unusual incoming files.
They suggested I go to an undergrad program for data science. I already *do* data science for money and I already have an undergrad degree. 🙄4
Two weeks ago, I chose my modules for my Master in Data Science. This morning, I received an e-mail to tell me it was a bug, I was not accepted.
So what's now
I guess I will kill myself6
data science is just a sexy word for statistics.
1% programming skills
99% practically all science thats not computer science8
When do you consider yourself an expert at a language?
More details: there is a really cool Data Science internship opening up near me that I want so badly it physically hurts me, but it asks for expert level knowledge of python, Java, or R.
I’ve only been studying R and Java for like 3 months, and Python for about 8 months, so I’m obviously no expert. When exactly does someone reach that threshold, though? When did you realize you were an expert at a language?13
zero motivation for anything, i just want sit outside in the sun at the lake with ice cream and not in front of a screen. And not being bothered by the new vacum cleaner loud deep learning rig of the data science department in this open floor office.
I fucking forgot my noise cancling headphones. FML2
This week I reached a major milestone in a Machine Learning/Music Analysis project that I've been working on for a long time!!
I'm really proud to launch 'The Harmonic Algorithm' as an open source project! It represents the evolution of something that's grown with me through two thesis' (initially in music analysis and later in creative computation) and has been a vessel for my passion in both Music and Computation/Machine Learning for a number of years.
For more info, detailed usage examples (with video clips) and installation instructions for anyone inclined to try it out, have a look at the GitHub repo for the project:
"The Harmonic Algorithm, written in Haskell and R, generates musical domain specific data inside user defined constraints then filters it down and deterministically ranks it using a tailored Markov Chain model trained on ingested musical data. This presents a unique tool in the hands of the composer or performer which can be used as a writing aid, analysis device, for instrumental study or even in live performance."1
Should I actually look into getting a dev job..?
*I have a high school diploma (graduated three years early)
*College dropout (3-4 months, Computer Science - Personal Reasons)
*No prior work experience.
*Good textural communication skills, poor verbal communication skills.
*Currentally unemployed. (NEET :P)
*I have extensive personal experience with Java, and Python. Some Lua. Knowledge of data generation, parsing, Linux, Windows, Terminal(cmd & bash), & Encryption(Ciphers).
*Math, but very little algebra/geometry (though, could easily improve these).
*Work best under preasure.
Think anyone would hire me..?13
Code never lies
Comments sometimes do
Code lies too, especially when you train a neural network 😂😂
The joy of a complete trained model.
Onto the next task. Use the model to automatically infer handwritten figures on a bankers check/cheque.2
A girl takes less time in getting ready as compared to windows 10😂😂😂
The guy who became my manager just pushes to the prod branch.
On a repo where another team clearly set up development and production branches.
This guy has been pushing code like crazy and I always wanted to take my time setting things up properly in our team: TDD, CI/CD, etc.
Because he pushed so much he became my manager and I was seen as unproductive.
Data Science and software development best practices just dont coexist it seems.
Yeah yeah, it's up to me to start introducing good practices, but atm "getting it done" takes priority over the real based shit.4
I created a curriculum to homeschool myself way up for a MSc in AI/ML/Data Engineer for Application in Health, Automobiles, Robotics and Business Intelligence. If you are interested in joining me on this 1.5yrs trip, let me knw so I can invite you to the slack channel. University education is expensive..can't afford that now. So this would help but no certificate included.17
Cousins came over...
Me: just compiling some python code, opens up jupyter notebook to take a look at some data science code
Little Sis: *looks at jupnb dump on cmd*
Whoa are you Hacking?
Me: yeah. I got bored of whole Hacking command typing thing so I opened up my hacker console.
Me: you know what, typing is too tiresome, I'll connect to it with my mind
*sits in yoga pose*
Little Sis: Screams at the top of her lungs and runs to aunt
"DAVE IS HACKING MATRIX"3
So according to Pfizer, ~39,000 people received a second dose of vaccine/placebo. So about 20,000 got the placebo, and out of that group only 85 got infected in the span of 3.5 months, during the second wave. That's 0.425%.
So they either:
* Proved Covid is not infectious
* Manipulated the shit out of their data
How that fuck is this considered valid analysis?!
If I tried to publish a paper based on such unreliable, statistically meaningless data, I would be rejected without a blink.62
Anyone else taking Harvard's CS50 via edX? It's so awesome! You get a better understanding of Computer Science and stuff. I'm loving C! It feels so close to communicating with the machine. Memory allocation fascinates me, too. Is this why it's fast? If you feel like you're lacking with the CS fundamentals although you can build apps or websites already, I recommend this. This is better than my whole years in college!9
in the past 48 hours my partner must have asked me 50 times to create an "AI" that can get the data we need off of wikipedia.
Background: I am in AP Computer Science AB but I have been programming long enough that this class is a joke. We were assigned to partners with the task of creating a search engine that finds informations on wikipedia("which is dumb because thats what the search tool is for") so I created a Java Web-Scraping program in probably 30 minutes and showed my partner. He told me I am completely wrong because it would be "cool" to incorporate machine learning into the assignment.
Do I even tell his what machine learning is or should I just let his figure it out?7
Yesterday I met my cousins who are old enough to have kids. It was a good talk with them bringing back the old memories. One of my cousins has a barely 5 year old kid. I tried to talk to her and the conversation went like this:
Me: “hey there! Hi, how are you?”
She: “Good. What do you do?”
Me: “I am a computer science engineer. What do you wanna be when you grow up?”
She: “A scientist.”
Me: **thinking calmly, “Oh, what kind of scientist?”
She: “A Data Scientist.”
Me: **Two seconds of silence and decides to leave...4
Programmer’s life cycle:
- Nothing can stop me today
- A bug huh? let's squash
- I can’t fix this
- Confidence crisis
- Questions career
- Questions life
- Oh it was a typo
- Nothing can stop me today1
I'm that person that makes shit inefficient code, hello everyone. I'm just now learning algorithms and data structures after years of employment.
It is my hope to one day atone and be forgiven for my crimes against computer science.3
This is just straight up a joke. Head of data science has had us implementing something based on a paper.
I raised some "concerns" about it a while ago. Found out today they'd not even read the paper. We're pretty sure what we've been asked to work on doesn't solve the problem it's meant to solve...3
Visual Studio (Code)
-Cross-Platform App Development
-Lightweight (Installer VS2017)
-Many of Langs (C#, js, Python, F#,...)
-Data Science Tools built in
Switching to macOS was an entry to paradise.
I go to Windows only to play Call of Duty. It’s crap and always will be.
P.S no comments on Linux.8
You know. I think people trashing chatgpt detracts from the fact that if it is actually functioning as stated it's still a goddamm miracle of science!
I mean are we all really that jaded ?
You can type a plain English request in and a COMPUTER PROGRAM sends you a Novel response that may reflect the bias of its dataset and the bias of people trying to keep "secrets" but otherwise it sends a response formulated from extensive data.
That's a breakthrough
Quick acting like an alpha that was frozen years ago apparently is the RTM!28
Worked as a student in a big company. Just doing data entry and checking product data. It was a nice part time job at the same time with computer science study. After a year I asked for something else and switched to the Android Team. I said I could do a little bit of Java and wrote for another half year Unit Tests. That was the point where I really learned coding and got experienced. Would never learned so much in my study because I was lazy. Now I can call me a Android Developer. Still love the company for giving me this opportunity.
Just changed my wallpaper to be the Tensorflow logo and added 'background in data science' to my CV.2
"Non-devs never call Steven Spielberg to have their TVs fixed."
But sure they MUST call a dev to update their Android, iPhone, Windows, installation of Anti-virus, data recovery, malware removal, to shortlist 20 laptops from market, ask for what printer to buy, why is there a weird animation in Android sometimes, come borrow my WiFi, have their phones and computers fixed, RIP old audio CDs (yes!), fix Bluray, fix anything electronic, repair their bike, teach them science, politics...
This While True loop never escape.1
Promising the boss a 95% model accuracy when the arXiv paper says it can only reach 86% is what I call self-checkmate2
Me to university: You taught us C++, java, DS Algo and PHP only right?
Me: So our college project must be around these only?
University: Yes... But No, here are your only options for our college project
1. MEAN/MERN Stack Website
2. Machine Learning
3. Data Science
5. Android App
Apply for a data engineer role.
Get invited for a data science interview.
HR says they're building AI and I were to supervise another person writing its algorithm.
It's a media company.
Visual Basic at high-school, pascal and C and Java at University. VBA for macros on a job. html+css+js learnt o er a weekend to pass the screening for a new job, then ruby and php on that job to build internal tools. Now I am into python for data science. It has been fun.1
so I left uni after my PhD and joined a start up where the boss is a Cambridge grad who does coding and is like 50 years old (he never told us the true value), the CTO is very talented and another dev who quickly became my best friend and me doing data science. the 4 of us worked together like friends and the efficiency was fantastic, there's no bureaucracy bullshit or shit boss talks. We built the whole thing from scratch (okay I admit they did most of the building) and to this day, we work just has we have been.
I can’t believe that Python takes the 3rd place of the most commonly used languages in 2023.
Stack Overflow Developer Survey:
Wtf?! I would have thought that it’s just used for small scripts occasionally that don’t change frequently and just rot in some project for years.
And of course there are some niche Data Science and Math areas where Python is used primarily.
Maybe Machine Learning and "AI" as well.
But 3rd place? Almost 50% of devs use Python?
Can someone explain?25
Meeting with middle level managers.
Me - data scientist, saying data science stuff, like what accuracy we have and what problems with performance we managed to solved.
Manager 1: Ok, but is this scrum?
Manager 2: No they're using kanban.
Manager 3: That's no good. We should be using DevOps, can we make it DevOps?
So yea, another great meeting I guess..4
So I finally got a job where I was an intern as a Data Scientist.
PS : I am a non-computer science background guy, who made it through.3
Someone asked me about Ruby vs Python.
The flashbacks regarding the python vs ruby wars started to kick in man.
I always liked Ruby faaaaar more than Python. And find Rails to be a far superior alternative to Django as the web framework champion from each side and Sinatra far more enjoyable than flask as the micro framewor champion on each side goes.
But this guy is very math oriented and likes the idea of data science for which Ruby has a disadvantage in terms of available ecosystems.
You can't take my blocks and dsls from me tho. I will fight for them.2
The everything is Data science craze trend.
Honestly it's not even sustainable with every kid and their grandmother wanting to be data scientists because it's a 'passion' and a 'dream job' and all of that click bait stuff.
It's just become ridiculous at this point and I doubt we'll even have the long awaited 'breakthroughs' people have been talking about for so long.
Also I have a strong feeling everyone thinks it's their 'passion' because it tops the lists of highest paid jobs out there and everyone thinks with 3 months of training they're a fully fledged data scientist because some Python or R package implements all the algorithms he could ever think of using.
Add to that the fact that most advertised data science jobs are actually data engineering where you maintain a date store and that's it.
Agree or disagree that's my piece and if you can convince me otherwise I'll be surprised because I've been subscribed to this idea for so long that it lost me some real good opportunities because I thought it was just what I was meant to be doing which turned to be false after I thought about it. There's a million other jobs that are more impactful and with pursuing.2
A fellow <insert some data science title here> giving me more acknowledgement than all of the old guys running the show and, erm, "leading"?
Fucker left me behind, good for him.
While scraping web sources to build datasets, has legality been ever a concern?
Is it a standard practice for checking whether a site prohibits scraping?27
Over the last year, I’ve only started learning computer science at uni, never done it before.
I’ve done units in:
- Alg. and programming fundamentals in python
- Intro to comp sci
- alg. and data structures
- theory of computation
Guess the point of this is, “why do people code, what aspirations do you all have?”
Cause rn, I’m all about “I have no idea what I’m doing, coding just seemed cool and I wanted to try it out.” Don’t know where to go
Someone inspire me???
Here is a legit reason for you to brag about what you do and what you’re going to do 😉13
Looking for advice, serious advices.
I work in C.
Also, I work in Python.
I have worked for a couple of year in C++.
I have a fair knowledge of the Data Science workflow, and some experience in Machine Learning.
I have tinkered with some other languages (Java, Ruby, Go, JS among the others, nothing serious nor professional)
I'm the kind of person who needs constant problems to face in order to keep engaged, satisfied, happy. And I need to learn new stuff, or refining my knowledge constantly, or I stagnate. I believe that this is true for quite a share of people here.
I would like to spend some spare time (I seldom have) in a project. Personal projects are rarely good enough to improve one's cv, so I thought I could partecipate in some Open Source projects.
Does anyone here have some suggestion about some interesting and satisfying OSProject, or some general suggestion on the matter?
It would be so apreciated.3
Merry 2018 in advance.
If it aint a secret, comment w/ your new years resolution so other lazy fucks can get motivated.
Mine: a 3d game (godot), releasing my data science java libraries, building some kind of robot8
Waking up and guess the first item on my feed?
IBM research just released Snap ML framework that's supposedly 47x faster than Tensorflow. Now, i like advancements but fuck i just finished developing my Tensorflow model, and i don't want to rewrite this stuff again!2
Data scientist and related devs, how do you handle large datasets?
I was given a .txt file containing +1M edges of a directed graph. I tried to analyze it with networkx, but my computer killed the process as it was eating too much CPU/memory.
I would be grateful for any advice!23
Being in Data Science and Mobile Development taught me :
1.Always be curious
2.Never stop learning
3.Never give up
4.Don't be afraid of Experimenting new Technologies
5.Don't always take ,Give More ,Share More!!
Do Share What your Domain taught you in the Comments 😀4
Riddle me this
Client wants solution based on open source software.
Any additional software that I write (let's say, an offline store plugin for Feast feature store) to add missing functionality has to be closed source.
Fuck you. Intellectual property my ass. You and me wouldn't even have projects if it werent for OSS.
Good luck maintaining the plugin after I am gone.
I'm doing a lot of work and will have close to nothing to show to future employers.
(BTW, if it were for the old Microsoft model of code source, I would have never become a programmer of any sort. God bless OSS)3
INTERVIEW. It tells everything about the company. I recently applied for a "big" company for the position of ML Engineer. The Job description was like "someone with good knowledge of visual recognition, deep learning, advanced ML stuff, etc." I thought great, I might be a good fit. A guy called me the next day. Introduced himself as a manager of the Data Science team with 8+ years of experience. Started the talk saying "it is just an informal intro". But things escalated very quickly. Started shooting Data Science questions. He was asking questions in a very bookish way. Tells me to recite formulas (like big formulas). When I explained to him a concept, he was not understanding anything. Wanted a very bookish answer. I quickly realized I know more about ML stuff than him (not a big deal) and he is arrogant as fuck (not accepting my answers). Plus, he has no knowledge about Deep Learning. At the very end, he tells me "man, you need to clear up your fundamentals". WTH??? My fundamentals. Okay, I am not Einstein or Hinton, but I know I was answering things correctly. I have read books and research papers and blogs and all. When I don't know about things, I tell straight away. I don't cook answers. So the "interview" ended. I searched that man on LinkedIn. Got to know he teaches college students Data Science and ML. For a fee of 50,000 INR. It's a big amount!! Considering the things he teaches. You can find the same stuff (with far higher quality) free of cost (on Coursera, Udacity, YouTube, free books, what not). He is a cheater. He is making fool of college students. That is why I sometimes hate "experience". 8+ years of exp and he is such an a**hole!! BTW, I thanked God for saving me from that company. Can't imagine such an arrogant boss.
TLDR: Be vigilant during interviews. It tells a lot about the company.4
C might be a pain to write, but holy cow does it run circles around python from a performance perspective. Easy to forget in fields like data science, where python is the default8
I am so fucking happy I spent time and money getting a college degree in computer science so I can write python scripts to label data. Seriously fuck my lead5
#1 Sharing co-working space with my wife.
#2 my home office! (I transitioned from music industry work into data science over the last few years)8
Girl (trying to turn things on): people from my country are great in bed.
Guy: what data points do you have ?
*Girl walks out of the room*
I recently tried to apply the same data analytics rationale that I use at work to my personal life. This is not a rant, it is more like an data storytelling of an actual use case I would like some input on.
I set a goal - gotta thin up a bit and calm down my ticker - and got a (almost unreasonably expensive) field expert consultant to yell at me about it for a couple hours.
I unravel the metrics - there is like a million weight-related KPIs and most say nothing at all. I have never seen an non-infrastructure measurable subject that could not be resumed to 2-5 performance metrics. I got overall weight, how well my nine-years-old business suit fits me, heart rate, and day-after relative muscle pain (it will make sense soon).
Then its data-pipeline time. I bought a cheap weight scale and smartwatch, and every morning I input the data in an app. Yes, I try to put on the suit every morning. It still does not fit.
After establishing a baseline, I tried to fit different approaches. Doing equipment-free exercises, going to the gym, dieting. None was actually feasible in the long run, but trying different approaches does highlight the impacts and the handling profile of each method.
Looking at the now-gathered data, one thing was obvious - can't do dieting because it is not doable to have a shopping list and meals for me and another for the family.
Gym is also off the table - too much overhead. I spend more time on the trip there and back than actually there.
And home exercise equipment is either super crappy or very expensive. But it is also the most reasonable approach.
So it is solutions time. I got a nice exercise bycicle (not a peloton), an yoga mat (the wife already had that one) and an exercise program that uses only those two resources. Not as efficient without dieting, not as measurable and broad as the gym, but it fits my workflow. Deploy to production!
A few months pass and the dataset grows. The signal is subtle but has support - it works! The handling, however, needs improvement, since I cannot often enough get with the exercise program. Some mornings are just after some hard days.
I start thinking about what else I can improve in the program, but it is already pretty lean and full of compromises.
So I pull an engineer and start thinking about the support systems and draft profile. What else could be draining my willpower and morning time?
Chores. Getting the kids ready for school, firing up the moka pot, setting the off-brand roomba, folding the overnight-dried clothes, cooking breakfast, doing the dishes, cleaning the toilets. All part of my morning routine. It might benefit from some automation.
Last month I got that machine our elders call "wasteful" and "useless crap lazy entitled Americans invented because they feel oh-so-insulted for simply doing something by hand like everyone always did" - a "dish-washer".
Heh, I remember how hard was to convince my mother-in-law that an remote-controled electric garage door would not make she look like an spoiled brat.
Still to early to call, but I think that the dishwasher just saved me about 25 mins every morning. It might be enough to save willpower for me to do more exercise.
This is all so reflective of all data analytics cases really are out in the wild - the analytics phase seems so small compared to the gathering and practical problem-solving all around. And yet d.a. is what tells you that you are doing the wrong thing all along. Or on what you should work next.7
Trying to switch my job. Applied for a well known company. Gave an interview today. I don't fucking get the obsession of these developer recruiters so fixated on data structures and algorithms. I know it's a massive part of computer science but guess there is no fucking room left to innovate in there. There are legitimate researcher teams working for implementation of these barebones inside system foundations. No general software developer gives a fuck about this piece of shit discipline of study. You wanna know why they propagate this as the panacea to test people because it's fucking easy. Give a project to somebody as interview procedure, it'll take time to bring out an interesting problem and an interesting solution to that. Sorry to say but all these data structure enthusiasts are nothing better than board game enthusiasts.
Also why can't you refer existing solutions to create your solution. I've seen some good problems which actually require you to think. But again those are heavy and can't be tested so you're left with reversing a fucking linked list with O(1) auxillary space. Fuck me ig.
Moreover, what the fuck is wrong with the moral policing internet crowd. Its so sad. I've hardly seen anybody rant about this piece of shit system put in place to push the absolute dead-end nutcases up the ladder. Every other search for it returns a Quora link with some Indian guy complaining about his interviews and in the comments you have the same scholars sitting in their data structure throne imparting knowledge about how data structure holds the fabric of reality together.
I don't hate data structures and algorithms as a subject. It is cool and quite extensive but once you try to make that as a metric of all the knowledge in the world, you've lost my drift. Maybe I'm just angry with the state of things. Maybe I'm just angry with token Quora crowd.4
Last week I got told by an incoming CTO, a week old to the organisation, that I'm good for nothing and unable to produce any work. He told me that he'll replace me and put me in a team where I'm more resourceful as I have been consistently underperforming. (He doesn't understand data science yet fyi) Then, he informed he's hiring 5 new teams members.
Me (junior data scientist) being really passionate about work was shook to hear this. So much so that it took me a week to even recover from it. I have considered counselling sessions too.
Week later, 5 new team members decide to flip his offer and not join. Another existing senior member decides to leave as well. Meanwhile, major issues in existing systems emerge and only I could solve the same. Still haven't heard back any from him though.
Is this the industry standard though ? Is this how CTOs normally function ? Throwing shit at people without knowing their value or valuing their efforts ? Especially with junior developers. It's only been 2 years in this profession and I've not met more than 3 genuine and helpful people. Maybe it's just my organization.9
Well, my country has a Degree called Bsc.CSIT which literally means Bachelors of Science Computer Science and Information Technology. I completed that degree and was employed right after I completed my degree. I have worked in two offices and no one cares what degree I have.
So I think Degree is not that necessary here in Nepal as long as you can get the job done.
Now I am about to pursue a Big Data related degree hope that is not as worthless as my current degree.1
Was training a model for an hour on paid GPU after which it showed a deprecation error and crashed my Jupyter notebook.5
Clustering high dimensional data - SOS!
I have to cluster documents. I computed the tf*idf, but I have ~45K docs with 28K words.
I did minibatch kmeans which works alright, but everything else runs forever. I need to compare 2 clustering algorithm, so I need at least another one that works. In this life time.
Husband looking into online schools for CS. Anything data science related. He loves math (and is freaking good at it) and teaches himself R for fun.
I put 0 thought into my own schools (terrible, I know, but not likely to change any time soon). Any suggestions for good online data Science programs, with a math minor potentially?
It's for his bachelor's.6
> be me
> studying 1.5 years liberal arts stuff and general education class at community college
> transfer to a 4 year university.
> realize I need a major
> Realize I also I wanted to 9ne day have a family.
> realize family would need money
> "struggling actor" not a great choice
> pray about what I should be doing
> get distinct impression that instead of attending the session on majors at the college of fine and performance arts to go to session with the college of Science and engineering.
> hear pitch for computer science.
> signup for introduction to programming taught with c++.
> A couple semesters down the line take 3 classes all at once Discrete Math 1, Linear Algebra, and database design and administration.
> around week 6 realize that all 3 classes revolved around sets and set logic and set math.
> realize rdbs's are "applied" set math and that Each class a little more "applied" than the former.
> Be genius at SQL and set math
> havereally smart database teacher mentored me
> get introduced to the recruiter at the career fair.
> get interviews
> get flown out for 2md interview
> get internship
> do work, and get project back under budget
> a job offer
> finish senior year
> start as a "real" developer supporting business data and analytics.
In a mediocre job since last 4 years with just a developer designation, but we simply use Java based tools and products to do most of our job. Need to study for a change in job.
Literally every morning:
"I need to focus on Data Structures and Algorithms. So let me stick to Java for now."
Back to the same routine.
2 months have passed and I have not seriously studied or concentrated on anything :(
what's your expirience with business intelligence / data science? Do your company has a own department for it?
If so how does it affect you?2
We specified a very optimistic setup for a data science platform for a client....
Minimum one machine with a 16 core CPU with 64GB RAM to process data.....
Client's IT department: Best we can do is an 8 core 16GB server.
Literally what I have on my laptop.
Data scientist doesn't use any out-of-memory data processing framework, e.g. Dask, despite telling him it's the best way to be economical on memory; ipykernel kills the computation anyway because it runs out of memory.
Data scientist has a 64GB machine himself so he says it's fine.
Purpose of the server: rendered pointless.5
How many of you guys are developers who are transitioning to data science and machine learning? 🤔12
I have a course at my university about personal data and it feels more than a law course than a computer science one. I asked the teacher why do we have to be taught that subject and how would we be able to use what we learn in real life and she got triggered, telling me that with just by coding I won’t achieve anything and i have to learn more topics and if I didn’t want to be taught this subject why did i choose the university.
I just made a question you fuckin butthurt, chill the fuck out.3
I am Graduate student of applied computer science. I am required to select my electives. Now i have to decide between Machine Learning (ML) and Data Visualization. My problem is Machine Learning is very theoretical subject and I have no background in ML in my undergrad. In data visualization, the course is more focused towards D3.js. Due to lack of basic knowledge i am having second thoughts of taking ML. However, this course will be offered in next Fall term. And i am also studying from Coursera to build my background till that time.
I know there is no question here but I need a second opinion from someone experienced. Also, please suggest any other resource that I should look into to build my background in ML.3
I need to buy a laptop to replace my 5 year old one. My work is mostly in data science. My budget is really flexible. Any suggestions?6
I spent 2 hours on Python logging system instead of doing real data science.
Really this module feels poorly designed.
What is it about robot collected data that makes researchers so anal? Like, dude, it's not even personal data. It's literally robot's joint motor recordings. It's not nuclear data, so why the fuck do you protect it like your life and your country depend on it?
I hope you get fisted by that data every night and how it will end up in oblivion sooner because you didn't publish it. You asshole.8
I started iOS app dev thinking there’s good scope in the future,now I hear people saying app dev is gonna die switch to data science. Tf6
So as you may know, I am job hunting. One company I found, called ruby, sounded interesting (the name helped). They were looking for data science type stuff.
I was about to apply when I got the feeling I should check the description. They were boasting about their flagship product.
Needless to say, I burst out laughing and moved on.4
IEEE is full of shit! Why the fuck can't i download research papers when I have already paid for the subscription???
Fuckers, i didn't pay to view your old looking website!2
2018: Data Scientist = Stack overflow copy pasting: "I followed a 12-hour 'DS' course on Lynda!"
lm() # science2
Why is python supposedly something big data people use ? Sounds like r and stats and well I don’t see the adoption of that though python is used somewhat I note in a lot of Linux apps and utilities
Just seems strange that an interpreted language would be used that way to me or am I an idiot ?35
Data scientist 🥼 out there. I've got this data where some of its columns have n-sized integer vectors for content for each row. Their data is of qualitative value. There's no scale or distribution to them, it's all random and discreet absolute values. Is getting all unique values for all those vectors and turning those into dummy variables a bad idea? Should I turn it into graph data?
Or there are other ways of decreasing my dataset dimensions? Mind you I can't change the dataset's indexing.5
Data Science MSc instead of Computer Science. Or realising that my first 4 years of work was as a Data Scientist and I should have asked to have my job title reflect that. Skipping faang, at least relatively early in my career (that's a whole thing I want to write about but not rn). Not spending a year out of work due to health problems & nearly dying.
It could have been better, but I've enjoyed it.4
I just received this.
"I'm just saying that one should be proud to be able to import libraries and call themselves Data Scientist who can apply machine learning."
What the actual fuck.6
Am I Data Engineer or Software Development Engineer ?
I design the infrastructure for analytics data, and I build the infra entirely including an development. Except making reports out of the data.
What I'm supposed to be called ?
Data Engineer ?
Software Development Engineer ?
Definitely not an Data Scientist. Official designation given by company is Data Engineer II. But what I'm ?
Confused, someone help me please.5
Lots of good suggestions up in here.
My personal prefference:
Such as there are governing bodies indiciating how a programming language evolves and a web consortium...there should be a computer science one. That dictates fundamental approaches covering everything that belongs to this wonderful branch of science. Everything from math to differenr scientific branches all the way down to turtles. And for it to be standarized and updated. Indeed, if you want to spend your entire existence gobbling js in the form of web sites then that is fine, but you should have sufficient knowledge to branch out into more academic pursuits if required.
Also, updated tools would be better, every aspiring computer scientist shall be able to navigate through all major operating systems and programming environments regardless of their beliefs and or prefferences and schools should provide said environments in their classrooms.
Data Strucrutes and Algorithms should be a must. Software engineering principles should be a must. Calculus, Algebra and Statistics as well as Physica should be a must.
And succesfully navigating over different engineering areas should be a must.
Not to cleanse the industry. Fuck your elitist mentality. If you think that programming is a sacred art that should exclude people then I really hope you fucking disapear from existence. No, not to cleanse. But to expand the industry and maybe show people that there is more than fucking around between node modules or gemsets.
**drops your mom's fatass...i mean mic**
Started Data Science course on big data universuty. The outcomes are heavily dependent on domain experts/stakeholders!!! Since all the answers are false positives and need to decide what make sense with the help of domain experts. And most of the Data scientists are not from programming background, they are domain experts who turned into Data scientists. Thoughts if I should continue with learning big data/data science, knowing that I have knowledge in information retrieval and search engines.
I am studying an online data science course in python offered by Microsoft.
The instructor uses Surface book and also has a Mac book on his desk for backup because windows.
He uses chrome all the time for his explanation to run jupyter.
The point is even they know their tech is shit but still "Windows has set your default browser to edge" - this happens
Colleges now require proof of vaccination but admins are worried about the spread of fake vaccine cards
My mindblowing solution: require students to submit a covid antibody test result instead.
You can't spoof the lab test result number and it can be easily verified by calling the lab...
Can even create a site for that...
Worried about privacy... Have labs upload a hash of the data...
And user submit their hash...
Clearly nobody asked a dev for they're input... again3
Hey guys any advice/study plan for a 22 year old C++ Server developer to transition into data science ?
P.s. currently based in London4
Anybody have any great tutorials about web scraping with python? The data science courses I took only covered maipulauting and visualizing data not getting it.4
Junior Software Developer Job( $37k-$42k USD)
-1 year experience
- object oriented design and implementation
- management of relational and non-relational such as Oracle, PostGreSQL and Cassandra
- Lifecycle and Agile methods
- Familiarity with the Eclipse development environment and with tools such as Hibernate, JMS, ,TomCat/Gemini/Jetty, OSGi.
• UNIX skills, including Bash or other scripting language
• Experience installing and configuring software packages
• ActiveMQ troubleshooting/knowledge
• Experience in scientific data processing and analytical science in general
• Automated testing tools and procedures, including JUnit testing, Selenium, etc.
• Experience in interfacing with scientific instrumentation, potentially over IP networks
• Familiarity with modern web development, user interface and other ever-evolving front-end
technologies, such as React, TypeScript, Material, Jest, etc.
I am betting they don't get many people applying.8
I want to do something data-science-y.
Gimme project ideas, and where can I get the data for it?
Also, not looking for machine learning, just basic data analysis stuff.
I work with statistics/data analysis and web development. I study these subjects for almost a decade and now I have 4 years of practical experience.
This information is on my LinkedIn profile and from time to time tech recruiters contact me wanting to have an interview. I always accept because I find it a great way to practice interviews and talking in English, as it isn't my native language.
A remark that I always make to my colleagues wanting to start doing data analysis related work is that it may seem similar to development, but it's not. When you develop, your code work or not. It may be ugly, it may be full of security problems, but you almost always have a clear indication if things are functioning. It's possible to more or less correlate experience using a programming language with knowing how to develop.
Data science is different. You have to know what you are doing because the code will run even if you are doing something totally wrong. You have to know how to interpret the results and judge if they make sense. For this the mathematics and theory behind is as important as the programming language you use.
Ok, so I go to my first interview for a data science position. Then I discover that I will be interview by... a psychologist. A particularly old one. Yeah. Great start.
She proceeds to go through the most boring checklist of questions I ever saw. The first one? "Do you know Python?". At this point I'm questioning myself why I agreed to be interviewed. A few minutes later, a super cringy one: "Can you tell me an example of your amazing analytics skills?". I then proceed to explain what I wrote in the last two paragraphs to her. At this point is clear that she has no idea of what data science is and the company probably googled what they should expect from a candidate.
20 minutes later and the interview is over. A few days later I receive an email saying that I was not selected to continue with the recruitment process because I don't have enough experience.
In summary: an old psychologist with no idea on how data science works says I don't have experience on the subject based on a checklist that they probably google. The interview lasted less than 30 minutes.
Two weeks later another company interviews me, I gave basically the same answers and they absolutely liked what they heard. Since that day I stopped trying to understand what is expected from you on interviews.2
In the next three months, if I said jackshit about data science personal projects, you have my permission to backhand me into oblivion.
Need to stay on my current track...6
A bunch of people who know a bunch of frameworks but lack intrinsic understanding CS, therefore bringing the degeneration of overall quality.
This ultimately leads to:
1- shitty dev jobs (the future blue-collar job, always in risk to be automated)
2- super high-end dev jobs (most likely AI engineering, devops, data science)
As generations pass, this shapes out a whole new world economy.2
Today I came across a very strange thing or a coincidence(maybe).
I was working on my predictive analytics project and I had registered on Kaggle(repository for datasets) long back and was searching on how to scrape websites, as I couldn't find any relevant dataset. So, while I was searching for ways to scrape a website, suddenly after visiting a few websites, I get notifications of a new email. And it was from Kaggle with the subject line
"How to Scrape a Tidy Dataset for Analysis"
Now I don't how to feel about it. Mixed feelings! It is either a wild coincidence, or Kaggle is tracking all the pages visited by the user. The latter makes more sense. By the way, Kaggle wasn't open in any of the tabs on my browser.1
Fucking Django is the only project thaat claims to be for perfectionist but actually is a steaming pile of spaghetti code, data transfer objects, configuration objects and useless wrappers and shit. I mean this shits made by adults with computer science degrees how the fuck can they get that shit so wrong?16
I know it's quite soon to think about it, but: next year I'll graduate in cs and I'm still not sure about what to do after:
- I could just stop studying and start working
- study for another two years on a specialistic degree in Italy
- go take a two years master in machine learning, data science and ai in Finland
Which of these makes more sense?10
Story of a data scientist 😞
Spends 80% of the time trying to identify features, while the rest 20% worrying about identifying the features 😭1
Just bombed my first quiz in Data structures & algorithms on induction. Fuck.
And the midterm is a week from today.3
I'm a dev lead. I'm trying to consolidate a squad. There's a senior in it preaching the dream of career climbing and LinkedIn optimization.
Now all interns want to switch squads. I'm all for personal growth... but now everyone wants to be everything at once and productivity stalled. The job descriptions for our squad were perfectly clear, there's tons of different tech stacks... We can build a lot of cool things in this scope, and now no one can see them because Data Science or Data Engineering or Front-end is suddenly sparkling.
What are some job possibilities for software engineers that are a bit more challenging?
Software Engineering just became routine and with all the hin abstractions during the past years it’s not really a complex job anymore.
Thoughtful about data science but I think I’d get bored with that as well after a few years.
Looking for ideas with:
- technical skills
- have a lot if responsibility
- at least same pay
Would be interested in e.g. investment banking but that seems far out of my league (education wise)..9
"""Itty bitty frustration"""
# wannabe mode on
iris_dataset = sklearn.datasets.load_iris()
Not really a rant but a question:
I just got accepted into a coding bootcamp. Have any of you been involved in one? How was it? What would you do to make it a better experience throughout? Any advice or suggestions?
It's full time, six months long and I start in October and I want to make sure I make the most of the experience and absorb as much as possible.
Let’s just face it. Once the majority of people understand, data science (machine learning on custom behaviour mostly) will be the most disgusted job in the world. Mind boggling! You get shot right between the eye by doing it.4
Anything related to UIs or data science
That, working with a spaghetti codebase, or unhelpful and not nice teammates
We have been at a university of applied sciences today with our class.
It was kind of ok. I did expect more surprising things there. The whole building was smaller than our college (not the same as in the US). The rooms, where profs tell you things with a series of rows of seats, were dirty and pretty much used to the point that the seats are about to break easily.
I was expecting the university to be kind of the same as the universities you see in the movies lol.
It could have at least been bigger than our college and more "modern" than our school.
Anyways, let us get to the point here.
We were first in the foyer and afterwards in their main lecture hall.
We were introduced to the day's plans by a team of engaged students from different study programs and the president of the professors. Yada yada yada.
We got the full program in each room and each individual time span filled with study programs on a sheet of paper.
I did select pharmacy, media production, architecture, data science, applied computer science, computer engineering, mechanical engineering and future energies.
Pharmacy and data science were the most interesting study programs to me. I have asked one of the professors if deep learning was a topic for bachelor students, as well.
He said that that is only the usual case for people who got a promotion.
As an example he told me that yesterday he was at a conference hall with 10.000 people in which he gave a talk about deep learning. "Most of them were professors" he said. "Since this study program is new, it might change in a few years" he added to his conversation.
It is quite hard having to decide now.
Geo informatics and Aerospace Engineering did sound interesting, too.
There are a lot of things I would like to study at the same time haha.
Idk if I should just pick mechanical engineering first and add one or two after it to it. But that would take a lot of time. Geez.7
So after a couple years working at this company, the faculty I graduated from introduced a postgrad (masters) course in data science. I was always interested in the field, so I said fuck it and jumped the bandwagon...
I'm starting this week, I'm kinda worried my knowledge of maths and statistics got a bit rusty since graduation. Also most students there will be 4 years younger than me, and I'll keep doing my full-time job at the same time. But hey, at least I'll break the routine, and I can always quit my job if it turns out I can't do both, so whatever.
That's all folks!1
Today is my last coursework submission. I've touched on a lot of topics I never thought I would be able to do/even thought about. I like data science, but I just don't feel so passionate about it now. I just want to ditch coursework and do cool shit, but I never find the time.
Anyone else get somewhat "fed up" of what they've studied? How did you get through it? Just do the "cool shit"?3
Come to a weekly deep learning meet up this morning 8.30AM. The event start at 10 AM. While waiting I read news and play some game. As time near 10 o'clock I had strange feeling: The guest room so quiet, just me and 2 security guy.
Okay I think comittee that run this event a bit late because of traffc jam and I wait more. In the end the committee didn’t even show until 10.30AM. Later I found on another data science group today's event is postponed and I go home.
WHY DIDNT YOU GUYS MAKE ANNOUNCEMENT ON SLACK? YOU WASTE MY TIME WAITING 2 HOURS2
Hi guys i need to vent with you. I live in Portugal.I graduated in computer science with 16 (0-20). While I was graduating I worked in my university programming for iot and big data fields. I have one article published in a scientific journal. I was looking for a job in my country, and I have gone to 5 interviews where they wanted to pay me about 700 maximum because they say this is my first job. The house rent is about 300 and with food and daily needs I can't have money to simple things in life. It's sad that companies don't give value to people they just think in money. It's sad that our work and knowledge is not valued...7
ATTENTION PLEASE! Important announcement following:
Please check your interface implementations for correct byteorder according specification BEFORE YOU START COMPLAINING ABOUT DATA FAILURES ON EXCHANGING DATA.
Freakin hell, if I'd get some money for every byte order mismatch on testing interfaces, I'd be a be a billionaire.
And why are all those highlevel I-know-every-fucking-framework developer incapable of checking the real memory content of a datatype, and the real data content on the interface even if you tell them that their byte order is obviously wrong?
No, your system is not the centre of the universe and I don't care how you get your less-than-32bit-datatypes-are-for-assembler-usage-frameworks to change byteorder. It's not rocket science, if there's no ready-to-use-function then write those 4 lines yourself.
Next time I get to specify an interface I'll go for mixed-endian, just to make sure everybody involved knows the concepts of endianess afterwards.2
Never underestimate the power of a misplaced static in your Java to totally fuck you over.
I was busy with my computer science project for the semester where we have to implement a Sudoku solver without backtracking by using graph theory.
So there I was writing my data structure for the grid when for some reason all the cells were initialized with the value 8.
After a whole night of debugging I was about to start over when I realized I had made my array static.
And boom, it works. WTF!!!!!!!3
hey guys, im a total noob and new to this field. this post is open for criticism and suggestions.
so i wanna forecast slippage (dependent) using the % WT Plan (planned work, the predictor).
i get -0.35 for correlation.
and im using knn regression
how does this look to you? insights and comments are appreciated. thanks!43
that moment was a full semester
I was an Electrical Engineering major taking a Data Structures class and for the first time, I understood the title computer SCIENCE. In EE, you just blueprint all day long, but you never build anything. In CS you build and blueprint at the same time.1
I thought the field of Data Science was plagued with frauds, then I met "Data Science Recruiters."1
So I have question about my resume.
During my college time, I have done two projects related to politics:
One is to analyze the bias of media. What I did is scrape news covers for Trump and Hillary during election year and get sentiment analysis. The result is not surprising that among NY Times, NBC, Fox, Eashington Post, and CNN, Fox news is clearly favoring Trump, since Fox news is a republican news site.
The other project I did was to analyze the speech complexity and sentiment of the election. One of the observation we made was that Hillary and Trump are almost at the same level regarding speech complexity. However, Trump has a more positive sentiment in the speech, which is true consider how much he loves to say make America great again.
Now the question is, when I gave my advisor my resume, she said that I'd better not put those two projects on my resume since they are related to politics.
But, I am applying for a data science master degree. Seriously, I was just collecting the data and the data speaks for himself, why should I take those projects off my resume? I'm very proud of those projects I did as a matter of fact.
So here is the question. Shall I take off those two projects on my resume because they were political or I should leave it thereawarreally need some professional views. Please.1
My worst fight with a dev was definitely that time I tried to break the mould and build this incredibly tedious VB app to automate data handling through Excel, PowerPoint and Outlook. The other dev always said "you can do this" and "come on, it's not rocket science" and I was always like "yeah, dude, sure, but can you help me with this bit here, please, I'm so stuck on it?" He'd be all like "ofc bro, I got your back", but when it came to the actual work that needed to be done, he was all silent. Needless to say, now I have a rubber ducky to help me with my dev needs, as talking to myself felt like a nightmare. Guess that's what other people feel like when I strike up a conversation with them, too.
When professors rely on YouTube to teach you the syllabus, you know this is our education system **
Old one but popped into my mind today,
during 3rd year project, when all computer science students were mixed together,
I wrote the design / implementation doc
had a lot of acronyms as it was a technical course
referenced VS IDE
Idiot on team came along and decided to expand these acronyms
IDE became Intercompany Data Exchange
I lost the plot as he submitted it before i proof read the thing!
Dirty data? More like dirty laundry! And don't even get me started on explaining complex models to non-techies. It's like trying to teach a cat to do calculus. Furr-get about it!6
Hey all, can you guys recommend some great books on database theory and design. Something aimed towards intermediate towards advanced. It doesn't have to be sql, I just want to learn how to make a kick a#@ db.
Did you miss this? Let me know if you're in. We are starting soon. https://www.devrant.io/rants/2733781
Why the fuck do you ask Data Structures and SQL queries for a Data Science interview?
I feel pity on those companies who evaluate people based on the above for DS position.
I'm not a data scientist but lately I've learned NumPy, Pandas and now I'm learning Matplotlib and Seaborn and after years of Excel the improvement is astounding.
Excel is far easier to approach (I casually use it since I was 6) but once you need to do more advanced stuff it requires a lot of tricks and workarounds which needs to be memorized and are hard to find just by reasoning or are straight impossible without the use of macros which introduces many compatibility issues.
Pandas on the other hand is harder to approach but once you learn the concepts between its basic data structures you can do a lot with little "Google-Fu".3
Basic requirement of every Data Science college internship:
1) 2-3 years of experience... God damn it
2) Research and publications...(yeah right! in 2 years of college in which you taught me how to "work with" C on Turbo-C... I should have god damn publications... Well worked my ass on and have 2, but guess what campus internships says.. " no fucks given man", solve those damn segment tree question first then we will talk)
Its an infinite recursive while loop
So today in school I decided on my career choice. So I've decided on becoming a data scientist because I can still use my programming and I very much do like looking at data and researching things as well as program obviously :) so if there are any data scientists or data miners out there do you have advice?5
When you wanna be a Data Scientist and always land into internships where you are assigned with web development...
Learnt Node, Flask, Spring frameworks across different internshis...
Data scientists should be charged with animal trafficking and animal abuse because they import Pandas 🐼 and feed them to Python 🐍2
Data scientists unite!
I am working on a face recognition solution to identify and tag different faces in real time and currently using chinese whispers algorithm for clustring. The more I think about it the more inadequate it sounds (number of faces encoded increase over time thus the complexity). I've heard about YOLO but cant really decide. Please enlighten me!7
The gap of data science in industry and academia is so large. As a data scientist in a large financial company, I see that people are still using traditional models such as linear regression and SVM, while people in academia keep inventing new concepts and techniques such as deep learning.
I am not saying that we should completely embrace deep learning, or stick to classic methods. But I just feel so surprised that the gap is so large...Sometimes I am even thinking whether I am doing the right "data science"...3
It takes a fair bit for me to enjoy an online course, let alone want to recommend it.
if anyone is looking at using their "free" time learning something new during these troubling times, i would go look at the Packt Courses.
@whocares suckered me in the other day, and i have to admit, i dont regret it.
So with that i would actually say to anyone wanting to get into:
- Data Science
then checkout these workshops.
you can actually enroll into all of them using the free coupon, so theres that ☺
one down side is the lack of dark mode, but im sure we all have browser extensions for that.2
I decide to study Data Science the last 10 months, right now im very competent and have the skills get hands on real projects.
a few months ago i meet a guy on LinkedIn, i help him with some task for some stuff he was doing.
a few weeks ago he say he will hire me for work on an startup he is running with other guys.
after that he never get back to me and not get any response to my messages. i dont know what i do wrong.
now im here feeling cold and dont even know what todo for get some remote work as data scientist.
feels bad bruh :"( give me some directions, where to look for Remote Junior Data Scientist Job?9
Data scientist life begins when for him:
Forest becomes Random Forest and Tree becomes a Decision tree.1
I’m trying to update a job posting so that it’s not complete BS and deters juniors from applying... but honestly this is so tough... no wonder these posting get so much bs in them...
Maybe devRant community can help be tackle this conundrum.
I am looking for a junior ml engineer. Basically somebody I can offload a bunch of easy menial tasks like “helping data scientists debug their docker containers”, “integrating with 3rd party REST APIs some of our models for governance”, “extend/debug our ci”, “write some preprocessing functions for raw data”. I’m not expecting the person to know any of the tech we are using, but they should at least be competent enough to google what “docker is” or how GitHub actions work. I’ll be reviewing their work anyhow. Also the person should be able to speak to data scientists on topics relating to accuracy metrics and mode inputs/outputs (not so much the deep-end of how the models work).
In my opinion i need either a “mathy person who loves to code” (like me) or a “techy person who’s interested in data science”.
What do you think is a reasonable request for credentials/experience?5
Have any developer here ever gone on strike?
I've been at my company for two years, and know engineers that have been here for 3 years that have never got a single salary raise. A lot of the engineers are afraid to step up to management because of their visas literally being in the company's hands (lucky I'm not one of them).
I'm sick of it. I'm sick of my company playing ring around the rosy with raises and treating engineers like we're not human. Treating us just as cash cows. Yes, it's a business, but if sales, data science, and PMs can be treated with respect, we should as well.9
Gave me a career when I wasn't looking for one. Graduated with a mathematics and Management Science double major. Started as a data analyst and a Java architect saw something in me and gave me a shot. He was a dick at first and we had a minor squabble in which I defended myself and I thought I was done there. I later apologized and said I didn't have to because I was sticking up for myself.
I hated programming in college. Found it boring and thought I could teach myself if I wanted to. So in the real world, the problem solving and the variety of languages and software to work on opened up my eyes and allowed me to follow though my career.
For that I get a sweet paycheck, tons of opportunities and my children get to have and do things I never had the opportunity to do as a child.
So they're working on a way to store data in DNA. That means next generation computer science students have biology as a core course!
Here I am, 3:18 am, maybe I won't sleep today either, I hope I do... I'm going on with my uni project, a data science project. I've been wasting hours trying to understand why the fUcK 2 dataframes give me substantially different performances when they fucking shouldn't, since they should be the fUcKing sAmE. But apparently pandas is making fun of me... it seems that if you do something like:
and some columns in [some_cols] don't exist in original_df, pandas won't give a shit and create a NaN column, or 0 based on how many virgin leprechauns ate bananas for Thanksgiving.
Plus I'm fucking freezing, in this apartment the heating system turns off at 23:59, it makes sense if you're in the fucking bed where you'll be fucking warm.
I miss software development... I wanna finish this MSc as soon as possible.
And here I am, listening to post-rock, writing jupyter notebooks, trying to be fucking positive.
It's not like I hate data science (maybe?), but I'm burnout.
Maybe I'll rewatch another time the video of Mr Robot with the song Where Is My Mind.
I work as a data engineer in my company. My senior calls himself data scientist- he is 29 years old and recently did one MOOC on data science!
I wonder when my colleagues will find out about how much he really knows.
Till then I am cleaning and arranging his data, while he sits and earns a big fat package by citing one data scientist tag to his profile!! -_-1
Has anyone played around with kaggle.com to get into data science?
I’m good with data, good with analytics and good with programming but I need to combine those skills and learn whatever I’m missing.
Kaggle came up and it seems to have some nice data sets and challenges to do.
Need some advice. I’m a uni student and I really want to go into machine learning, data science, or computer vision. I have most of the skills and I feel I am fairly competent. However, the only professional experiences I have are web dev based. How can I make myself more appealing for data based roles? I really don’t want to do web dev anymore hahahahah5
Yesterday I was so high. Today when I open my data science project notebook and I saw that I used seaborn package without importing it...😂😂😂
How many of you are completing undergraduate degrees?
Are you pursuing any special discipline? (E.g software engineering, Data science...)
Or you are grasping a bit of everything?1
I see people’s Deep Learning project organization and library usage prowess on Github and I have fucking no clue where they learnt these ingenious tricks. All I can think of is learning from looking at other people’s GitHub. Is there a better way??6
Here's one for the data scientists and ML Engineers.
Someone set a literal date feature (not month, not season, but date) as a categorical feature... as a string type 🥺
I don't trust this model will perform for long2
Any recommendations for books on statistical analysis and data science?
The more survival guide & short manual types, the better.5
I'm Angularjs and .NET developer. I'm planning to learn addition skill / tool.
1) MEAN Stack
2) React (and related)
3) ML / Data Science
Because it'd easy for me to grasp and I can easily get projects for it.
Always curious about React, because of the hype maybe. But really wanna learn. And some gap for React developers.
Tbh, I suck at Mathematics and Statistics. Why ML / DS just because it sound fascinating.
Enough with JS JS JS, what else?
Please give your suggestions :)6
In the midst of considering to be an AI engineer, data science or embedded programmer.
Plan to retire from mobile dev, backend dev and webdev.
I'm rather clueless on mathematics. Should I pick up data science or stick to garden variety software development?2
Anyone here work as a Data Scientist? If so would you be able to say what kind of things you get up to in an average day?13
How many of you have formalized knowledge in computer science theory? Do you find yourself using that knowledge in your daily engineering life? For example, knowing random search algorithms, or obscure data structures. I ask this because of the modern "technical interview" trending towards discrete math instead of actual programming ability. Instead of coding projects I care about or reading research papers, I'm just doing discrete math problems to prep for recruiting. While it's not the worst thing to do I just wish there was a more direct way of interviewing a person's engineering abilities.1
I started working with Luigi, the workflow manager for a data-science project. Any input on how to test the Tasks or how does it compare to Airflow?
Can anyone help me please?
I am in 7th semester pursuing B.Tech in Computer Science but haven't done any internship and not much familiar with the data structures and algorithm, but beside that I have done more than 40 freelancing projects, certified Redhat system administrator, put a course on Udemy about WordPress and wrote 2 books.
The problem is I am confused whether I should pursue M. Tech or not or should I start competitive programming for the placement in next semester or prepare for internship in the next semester. I am confused between all of these things.5
Can any of you gentlemen kindly suggest me a good book on Data Science and ML.. because. I am busting my ass here trying to understand these fucking mathematical concepts.. PS I am a fucking beginners.2
When you can give a technical talk about Data Science but don't know which text editor you use
Just learnt python for data science online. Suddenly, have this awesome idea for an app. Thanks to kivy, I could work with python. But wait, X websites find it good enough, Y websites not. And cross platform frameworks seem to be all Js. Basically, pursuing new idea means starting from literal scratch.
Is learning a low level langauge essential for understanding high level stuff?
Say I'm using Python/some framework in it(for data science/machine learning), I don't see how knowing C would help me do it better. A lot of results on "benefits of learning C" argue that it helps understand/use high level stuff better.15
A note to the team designing recommendations on google ads:
Just because I search for deep learning concepts for personal learning, does not mean I will be purchasing every paid online data science course on the planet.5
Hello there been long, apparently done with exams and vacation(two-week vacation) and now students which make up the total population comes back, at first I wanted to rant about how the internet in my country was bad but to make it worse, during the vacation, when a huge majority of the school(university) population was forced to go home
Now the fastest you can get here is about 150Mbps(School restricted it for no fucking reason), and that is with the school's WiFi, mobile data is at most 30Mbps
BUT when the school population increases, the WiFi becomes 400Kbps and Mobile Data, pray it even works for a day
Also let me get this, I am an undergraduate, they haven't shown us any of the things that make computer science an undergraduate course: data structures, compilers, research on programming language, etc and finally at my final year, I wanted to make a kernel and be done with this school suddenly all the supervisors reject such project and rather look for a project that require a year to completeb ut the school reduces the time for a semester from 20 weeks(including exams and mid semester exams and break) to 10 weeks(without mid semester exams) and my supervisor just accepted my project,
Now I have 6 weeks to learn about AI and also make a working AI for queue selection and I am dying to finish some part for this week
It makes sense to learn AI and its mathematical basis (statistics and linear algebra) or unless I want to get a degree on the topic I’m wasting my time? If the answer is yes what are the best online resources/books which I can use?
To clarify I don’t want to specialize there and work as a “AI/data science specialist” (for which I believe a degree it’s necessary) as some graduates in shady boot camps expects to do. I’m just asking myself if I can teach myself enough IA to enrich personal projects in which IA makes sense and to become apre flexible professional.5
There is fun in using Google Colab.
They unveiled free TPUs on Colab.
It took me an hour of really slow training to realise that even if TPU is enabled, you have to code it explicitly to enable it.
After an hour I realised I was using only the CPU 😂😂
**crickets in the background**
What's the difference between data science, machine learning, and artificial intelligence?
I learned Django which wasn't really interesting because I'm more interested in Data Science but my friends with me at the university think you cannot do Data Science without learning Web Development. Thoughts?10
Hello Devrant! It’s ya boi!
Update. Currently back in school in the Netherlands. Studying law and technology. Yeet.
But yeahhhh so stressed omfg. Finals already in October. This school is a mess.
And I’m the middle of that my thesis got rejected so here I am. Crying. Asking y’all for ideas. Anything you can think of please say.
It’s gotta be tech but a legal question. Ethical is fine too tbh. So if there is anything you’ve wondered or think is of please tell me the question. 😭
all I’ll say is that the last one they said was too vague and not specific enough. And ideally it should be AI or data science but anything tech would do.
Not sure if this is the place to ask but thank youuu.9
so, next year i would like to get an internship at some small-medium sized company.
my GPA isn't the best in class, I'd rather say its below avg.
but I'm quite comfortable in multiple languages, built a couple of websites running in university with a user base of 4,000, right now I'm doing an online course in data science.
I'm not sure that they'd let me mainly because of GPA.
idk what to do.
ps: I'm planning for summer, I'm in 2nd year, i did an internship at real small local company as a xamarin dev
Do I have to be good at Mathematics to be good in Machine Learning / Data Science?
I suck at Mathematics, but ML/DS seems so fascinating. Worth a try if I hate Maths?
As they say, do what you enjoy doing.8
I know this is too late to ask this question, but am a final year computer science student, average in all core subjects with 0 knowledge of web development (except a few html tags, but not enough to make a wikipedia like website) or other professional streams.
I know java and python enough to make oop classes and understand code written in them.
A)study more about web dev/ml-ai/testing/other "professional" stuff
B) learn more and strengthen my core subjects , like operating system, algorithms, data structures, etc or
C) learn another core language like C/c++/assembly?27
My boss told me that he wants me to switch projects soon and I am not sure how to feel about.
- have been working on it for four years, mostly alone, sometimes with others
- i am more or less product owner and make most of the technical decisions
- i assign tickets to other when they get assigned to help me
- i inherited the code base and refactored a lot. Some parts i am proud of, others are a mess and others aren't touched by me at all
- one of my helpers would take this
- kind of data science plattform, so I have to learn a lot in this direction. Will be very complicated though.
- my first big greenfield project actually
- i will be mostly alone with this
- tech stack is fixed; no more php.3
I started to learn backend development for help a friend with his idea for an startup. i learn the basics in one week. then we put the hands on the project.
the first week everything was ok, we make progress fast and get things done, second week my productivity go to the floor. i found my self trying to do hacky stuff every day. never reach solutions. i was a mess.
Today i just broke, inclusive with my main Data Science projects im feeling bad. i quit everything a start watching Mr. Robot.
Right now i feels truly bad, but i have no option, tomorrow i will pit my hands again on all this shit, what more i can do? this is what i want to do.
The suffering and stress seems to be part of this job. We can only keep going.6
I have been doing web development on NodeJs and React and then I got bored and I started learning into Data Science, it's been a year since I have been doing courses and learning all the related fields and now I feel like I could use some hands on experience. So I'm looking for Internship as a Data Analyst or ML Engineer role.
Anyone who would be able to help would be great
Context: I am leaving my company to work at a data science lab in another one.
My senior dev (with PO hat): we need to gather data from prod to check test coverage. You will like it as you will be data scientist hehehe (actually not funny). You will have to analyze the features, and find relations between them to be able to compare with the existing tests
Me: oh cool, we can use ML to do that!
Him: Nope, we need to di it in the next 3 weeks so we need to do it manually.
Me:... I have quit for something....
What are you guys studying/what are your professions? What do you think of your study or profession? Also, what do you develop/what do you use to develop? I'm going to be studying bioinformatics next year, we'll be using java and python. The idea is to write programs that can find links in big data that stems from research on diseases and genetics. My two favourite subjects were always biology and computer science, (even though computer science in my middle school is a joke) so this study really appealed to me. I'm curious about you guys.4
Been a software engineer (swe) since a long time .planning to move to data science and stock investment.
I don't think I will succeed in career in Data Science and probably most of my cohort feels same.. Been up and down from adderall this week which i ran out of until early next month
I hate pl-sql and data warehousing. For this project we're extracting from source tables using a generic method equal for every student, changing the data and then copying to a table for analytics.
Everyone's project is fine. Mine occupies 90mb and exceeds the quota already. Delivery due in 2 days... So much for that cs grad. FML.
Maybe more specifically/realistically… i need a dev with data science experience that is also as optimistically psychotic as I am… I got wicked ambition. (Just make sure you can apply clear hermeneutic transparency to your math confined programmer brain)5
That's a little irritating and bemusing at the same time. About 24 hours ago I was involved in a discussion about DS on this very platform, and now my FB feed is full of DS ads. Not even verbally discussing the topic, just the posts here in DR. I'd be fascinated to know how they did that.2
So I've been studying masters in business analytics and big data. So far it's been 2 months and I don't have a clear picture about what big data actually is.
I guess that's normal and no cause of concern right guys ?
What do you think about blockchain ?, do you think that this technology will change our world for better one or not?
Anyone of you started a project using blockchain technology?2
Fuck Redux/ngrx. I'm done, I can't get my head around this ugly shit. All I wanted was to load/save api data in a clean way and display a loading indicator now and then. But definitely not multiplying my entire code base by 10. Actions, Reducers, Effects. What is this?! Fuck that rocket science.5
Is Python programming language used in AI and Machine Learning?
I have a query in regards to as we know python use in data science but is python also used in artificial intelligence and machine learning. I also want to know which technology using a python programming language.
Any suggestions would be appreciated!!2
Incomptent 3rd party "services" that you have to integerate with their non-consistent API error codes and useless 'new, more optimized' half broken ETL pipelines
the red haired girl and the blue haired girl.
there was this story about a programmer who spent years studying computer science before finally getting a job.
the dev studied only computer science and was put on blue team after a few days.
a few hours into one of the constant coding sessions, the boss told the devs that red team members and blue team members would be working in pairs.
the person from red team transferred the devs work to their data base without the dev knowing, then locked down the devs computer. the dev could not do anything. later, the dev got fired for not doing any work. after that, the company got millions of dollars, and the dev did not see any of it.
both the dev and the managers made a note not to hire any programmer who cannot secure their work.
it is not ethical to teach people programming without also teaching them cyber security.
computer networking, programming and security should all be the same major.
it is a bad idea to teach people how to build anything without telling them how to secure it.
the story above was just a scenario, but it probably happens way more often than people think.
Schools should teach both things in the same major.5
Helo everyone , I am planning on learning some new tools and languages side by side working on this project which would be an application for creating or managing some lists for any tasks or some web series and categorize them as on going or completed or planning for now and . I want to web scrap information about that task with some pictures and text information whenever you add an entry to make it catchy and informative.
For example if I add any series name like FRIENDS and label it as on going so to make that entry not look boring my app will add some pictures and texts from google using web scraping.
So which language and tools would be helpful for developoy such application ?
Ps: i am pursuing my undergraduate computer science engineering .
I have basics of python and c++ with some data structures as well as basics of Mysql data base.
I understand the basics of c++ and java. I want something that will help me grow and learn more complex code and programs. To be honest, i don't know what to do or where to go, my next computer science class will be data structures and algorithms. Can anyone recommend a good textbook or read. Id like to pass on websites in the likes of codeacademy.5
I just landed a job in data science, and I've been asked by my employer about the hardware specs of the machine that I'm going to use. What do you guys suggest? I don't want to be a financial burden, but I also want something that wouldn't require frequent upgrades.1
Listening to podcasts on programming and development, and one on data science peaked my interest. Any data scientists out there willing to share what you're actually doing with data science?1
Need advice. I am totally lost in this data science course. Should I just cut my loses and abandon the class or continue to make a fool of myself. I feel totally lost and the rest of the class hates me4
A conceptual overview of how Error Correcting Codes and Reed-Solomon works
Lecturer : Today you can save data into the internet.
The internet is not a storage device 🤦♂️
Correct terminology when talking to computer science finalists too much to ask?
And we complain about the government.1
So I have been using colab for the past 2 years. I liked how without any setup you can use kernels with GPU and TPU with some configuration.
But recently I can't train any model. It always goes runtime error, runtime disconnected, not to mention they have limited their total hours of usage for a day.
I know you are providing everything for free but this is just annoying. I dont mind if google wants to start a subscription plan for colab...its much better for fast prototyping than getting a cloud server from google or aws or anything of such sorts.
I have been trying to train a model with only 3 gigs of data and I cant complete the model, once I change the tab it shows Runtime Disconnected. DAMN it.
Sadly, I am trying not to use colab from now on.
But yeah I am frustrated with colab and their services.3
If I am getting a math PhD, and want to pursue data science, how important is getting another formal degree in DS to get a job?1
Question for data science people. Do you know some good multi purpose self tracking platform? Something like exist.io but more advanced? I want to setup custom tracking1
My new year resolution as a dev:
1. Competing in Kaggle competitions
2. Motivate peoples in data science
3. Do some cool project
4. Waiting for devRant stickers..
Have opted for Big Data and analytics this sem as Dept. elective. Can't understand anything in the lectures(as usual). Any suggestions how to start learning?(books, tutorials, courses, etc.)1
Im working as a software testing engineer with 2years of experience, I want to change my domain...I have some options infront of me..like Data Science, SAP HANA, Android app development, Full stack developer..I'm at intermediate level in java programming...please guide me to pick one from them
Hello friends, have a look on my first medium article “Random Number Generators”. If you have any doubts or queries, please comment
To those people working in Data Science/ML:
How did you land your initial job? Most profiles need you to have prior experience or a PhD.
I am trying to decompose a 3D matrix using python library scikit-tensor. I managed to decompose my Tensor (with dimensions 100x50x5) into three matrices. My question is how can I compose the initial matrix again using the decomposed matrix produced with Tensor factorization? I want to check if the decomposition has any meaning. My code is the following:
from scipy.io.matlab import loadmat
from sktensor import dtensor, cp_als
import numpy as np
//Set logging to DEBUG to see CP-ALS information
T = np.ones((400, 50))
T = dtensor(T)
P, fit, itr, exectimes = cp_als(T, 10, init='random')
// how can I re-compose the Matrix T? TA = np.dot(P.U, P.U.T)
I am using the canonical decomposition as provided from the scikit-tensor library function cp_als. Also what is the expected dimensionality of the decomposed matrices.1
Hey guys i need help, i want to switch to data field from react, i hv 2 yrs exp in react, should i go for data science? Can a frontend guy like me become a data scientist? And is the data science job fun when compared to react? Or should i go for power bi developer? I heard that power bi has a lot of scope as well. Thanks
So i have begun learning python and jupyter notebooks etc Do you have any advice for someone like me who's a react dev and trying to switch to data science?11
an old friend needs advice on how to get into the data science field as self taught and the learning path to take,
he is currently studying computer science in uni but doesn't trust the system like other students.
he is currently learning python and has been very committed to the learning process.
i know nothing about the data science field, any well explained advice will be very much appreciated.1
Anyone an ai engineer here? I rarely find any ai engineers anywhere. Especially here too. Almost no one talks about ai engineering and code. Makes me wonder. How difficult it is to transition from SWE into data science field and work as ai dev?1
Bwhahahah! Even after the excitement, business disruption, unpleasantness and pain, GDPR fails at its one job
So, I don't get the concept of dockfile. I understand it and what it does but, I learnt about it a few weeks back. Is it so important and necessary?10
What's your opinion about the HarvardX data science course ?
Is it worth it when i would like to start a job as a Data science junior ?
I'm here asking for your advice!
I'm a MSc student in my mid 20s, I took a gap year to work as an IT consultant and I'm planning on going back to studying, keeping at the same time a part-time job.
I already have some experience as a data engineer, developer and sys admin. I'm also mastering in applied statistics and data science and have a BSc in physics. I'm planning to relocate around Europe. All I want is a salary I can live with and a good work/study/life balance (perhaps work 24-30hrs a week?).
So far I've checked out a few IT jobs website and I've found some suitable positions. Problem is most of them are fulltime.
Where would you search for such a job? Is there any website/portal I should prefer? How would you proceed?
Should I prefer any place in particular (i.e. Northen countries)?
Thank you in advance <3
Note: I know it's a very broad question, that's because I'm open to any piece of advice you are willing to give me5
After watching this project based on GPT-3 where software is directly able to convert simple English sentences into React components:-
I first felt awestruck and then realised that it was a right decision to start learning data science while still having a successful career as a front-end developer🤓