Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
So after using my new MacBook I have 1 complaint... This fucking escape soft button being away from the edge, I understand you want to do symmetry with the finger print scanner but Jesus Christ it's annoying!
Edit: yes it's a minor issue but you notice it during use more than you think
34 -
Normal person : 365 + 1 = 366
Developer dealing with julian dates : 365 + 1 = 1(New year)
Business person : 365 + 1 = 001 (because they like symmetry in their file names with dates)
We found this BUG, now we are celebrating our new year by changing code in each of script to format string accordingly.
2 -
In 2015 I sent an email to Google labs describing how pareidolia could be implemented algorithmically.
The basis is that a noise function put through a discriminator, could be used to train a generative function.
And now we have transformers.
I also told them if they looked back at the research they would very likely discover that dendrites were analog hubs, not just individual switches. Thats turned out to be true to.
I wrote to them in an email as far back as 2009 that attention was an under-researched topic. In 2017 someone finally got around to writing "attention is all you need."
I wrote that there were very likely basic correlates in the human brain for things like numbers, and simple concepts like color, shape, and basic relationships, that the brain used to bootstrap learning. We found out years later based on research, that this is the case.
I wrote almost a decade ago that personality systems were a means that genes could use to value-seek for efficient behaviors in unknowable environments, a form of adaption. We later found out that is probably true as well.
I came up with the "winning lottery ticket" hypothesis back in 2011, for why certain subgraphs of networks seemed to naturally learn faster than others. I didn't call it that though, it was just a question that arose because of all the "architecture thrashing" I saw in the research, why there were apparent large or marginal gains in slightly different architectures, when we had an explosion of different approaches. It seemed to me the most important difference between countless architectures, was initialization.
This thinking flowed naturally from some ideas about network sparsity (namely that it made no sense that networks should be fully connected, and we could probably train networks by intentionally dropping connections).
All the way back in 2007 I thought this was comparable to masking inputs in training, or a bottleneck architecture, though I didn't think to put an encoder and decoder back to back.
Nevertheless it goes to show, if you follow research real closely, how much low hanging fruit is actually out there to be discovered and worked on.
And to this day, google never fucking once got back to me.
I wonder if anyone ever actually read those emails...
Wait till they figure out "attention is all you need" isn't actually all you need.
p.s. something I read recently got me thinking. Decoders can also be viewed as resolving a manifold closer to an ideal form for some joint distribution. Think of it like your data as points on a balloon (the output of the bottleneck), and decoding as the process of expanding the balloon. In absolute terms, as the balloon expands, your points grow apart, but as long as the datapoints are not uniformly distributed, then *some* points will grow closer together *relatively* even as the surface expands and pushes points apart in the absolute.
In other words, for some symmetry, the encoder and bottleneck introduces an isotropy, and this step also happens to tease out anisotropy, information that was missed or produced by the encoder, which is distortions introduced by the architecture/approach, features of the data that got passed on through the bottleneck, or essentially hidden features.4 -
Who designed keyboards? It would be so much easier to learn typing with 10 fingers if it would be symmetrical, like, have the keys be on top of each other like the numpad, the numpad looks nice, feels nice and it's easy to remember, the rest isn't clearly on top of each other and the indentation isn't the same
B is in the fucking middle7 -
I have so much to rant right now. So much. Life is pretty much a tight rope walk right now.
But the project I'm working on right now is annoying. I've ten days to release. It's a website on WordPress. They want complex animated crap using GSAP that fucks readability in the ass. I don't even know how to do animations. I don't JS damn it. Apparently readability is not what we want. We want attention grabbing. It's a fucking government initiative website for crying out loud. Why not put a carousel with my curated list of porn then? They also want the pages to be build using blocks of modules on a page builder so that the client can produce new pages without our help. I still don't have the final designs even. When I asked for the mobile designs, they told me to "just make it look not broken". Uggh.
They spent three weeks making some shit on Squarespace and now they expect me to finish the entire fucking thing with the slutty animations, disgusting text sizes and fucked up designs sense and symmetry in pretty much a week.
And the fucking fuck faced poopy pant regional manager had the balls to tell me I'm not being undersold if I accept his measly offer for a permanent position with a salary less than a 6k per year than what people in my school usually get. -_-5 -
This aesthetics in physics that is hard to explain to someone outside the field. How beautiful for example that you can express the whole classical mechanics in just 1 equation and electro magnetism in 4, that sense of symmetry and clarity they express. Essentially in what Einstein and others believed: that the universe is a orderly place not chaos and that its rules can be understood by our crippled minds.
And I think there is a similar notion in code. As physicists are driven to more general and powerful theories that shall some time explain all interactions of matter that we know of, programmers, I believe, strive for similar ideals: brevity, conciseness, generality, abstraction, powerfulness of your symbolic system - one line of code to end it all. -
I would have wanted to bring up SICP again, with the great big warning about the evil assignment operator and state and all the troubles that ensue (just think: concurrency).
But in a way, nothing has really come up from this or my attempts to dig deeper into "everything is a file/object" (Unix, smalltalk), neither from formal languages or the Curry-Howard correspondence. - Maybe there's just nothing, no firm bottom ground to discover. Like the physicists going for their world formula, but instead of a grand, beautiful symmetry that explains everything, we face a shattered world of (incompatible) theories, that is ever so more complex and chaotic through our theories applied to it. There may not be a Platonic ideal world of ideas, but rather partial constructs explaining some particular perceptions.
Similarly the one perfect programming language to rule them all, the perfect abstraction, pattern is probably just another prepubertal fantasy to be sunk.
So maybe instead of seeking the perfect epiphany, we should go for something quite different: the nagging, brooding uneasiness that something is wrong there, that there's something to be fixed... that even negative feeling would propel us to search further, not to stay in whatever is touted as the real thing.
Such irritations I found with Pieter Hintjens' writings. For example when he actively engaged in conspiracy theories. And I'm still not sure, if he just went off the cliff or he's even right alluding that these theories are an act of sanity, a self-defence against the hidden evil mights. I just don't know. Anything. -
You know the symmetry of this insanity is only possible because people do the same things mimicking the novel actions people like John boy took or reproducing things so closely that with memory fading in time basic decay model of forgetting which so far as I can tell may blur details but leave major impressions of even some of the most insignificant things people simply engage in "novel" actions like this rant.
How's it feel to be part of an oversized music box ?
Need to wander somewhere new
Top Tags
Weekly Rant
View