It was a mixture of factors.
Data was to be dumped into a S3 bucket (minio), this created an event and anouther team had built an orchestrator which would do a couple of things but eventually supply an endpoint a reference to a plain/txt file for analysis.
For the Java devs they had to [modify the example camel docs.](https://camel.apache.org/manual/rest-dsl.html)
and use the built in jackson library to convert the incoming object to a class. This used the default AWS S3 api to create a stream handle which fed into the OpenNLP docs. .
The Python project first hit a wall in setting up Flask. They followed the instructions and it didn’t work from setup tools. The Java team had just created a new maven project from the Intelij but the same approach didn’t work for the Python team using pycharm. It lost them a couple days, I helped them overcome it.
Then they hit a wall with Boto3, the team expected to stream data but Boto3 only supports downloading, there was also a complexity issue the AWS SDK in Java waa about 20 lines to setup and a single line to call, it was about 50 lines in Python. On the positive side I got to explain what all the config meant in S3.
This caused the team anouther few days of delay because the team knew I used a 350MiB Samsung TV guide to test the robustness and had to go learn about Docker volume mounting and they thought they needed a stateful kubernetes service and I had to explain why that was wrong.
Basically Python threw up a lot of additional complexity and the docs weren’t as helpful as they could have been.
If you have the freedom try Typescript.
The tsx files are almost identical to jsx except for the need to define the field types your ingesting.
While thats a little extra work, it allows Visual Studio Code to perform deeper analysis and provide much more helpful contextual hints.
I grew to love JSX and tried TSX out of interest and you couldn’t convince to go back to pure JS
You do, but considering the scales they process data I suspect Google would be better building Go tooling (or whatever the dominate internal language is).
A few years back I was trying to teach some graduates the importance of looking at a programming language ecosystem and selecting it based on that.
One of my comparison projects was Apache OpenNLP/Camel vs Flask/Spacy.
Spacy is the go to for NLP, I expected it to be either quicker to develop, easier to use, better results or just less resources.
I assigned Grads with Java experience Spacy and Python experience OpenNLP.
The OpenNLP guys were done first, they raved about being able to stream data into the model and how much simplier it made life.
When compared with the same corpus (Books, Team emails, corporate sharepoint, dev docs, etc…) OpenNLP would complete on 4GiB of RAM in less than a second on 0.5vCPU. Spacy needed 12GiB and was taking ~2 seconds with 2vCPU. They identified the same results…
Me and a few others ended up spending a day reading the python and trying to optimise it, clearly the juniors had done something daft, they had not.
It rather undermined my point.
My expectation is whatever the solution it needs to dockerise and be really easy to deploy via docker compose or Kubernetes so people can quickly and easily set up their own.
The front end is effectively static files so I would probably choose Apache or Express (whichever gives me a smaller docker image)…
For the backend I would choose Java for Spring Boot. An Alpine image with OpenJDK and the app is tiny. Spring has a library for every kind of interface making them trivial to implement but the main reason is hibernate.
Hibernate (now Spring Data) was the first library for being able to switch out databases without having to change code (its all config). A lot of mastodon instances struggle with the resource requirements of elastic search so letting small instances use something like postgres would seem ideal.
I have noticed Go/Rust still expect you to write or manage a lot of stuff Spring gives away for free. Python is ok if your backend is really tiny but there is a lot of boilerplate in how Python libraries work so complex projects get hard to manage and I assume interacting with the fediverse will add complexity.
Nah Linux Mint is a Kia Ceed.
Ubuntu is a Ford Focus, they successfully stole the volvo estate market (Debian). The car was fun, good value and very practical. It was everywhere. Then Ford started increasing the size, weight, price, etc… killing the point of the Focus.
So along comes Kia trying to make a competitor in the Ceed.
In theory the Ceed is a great car, its super cheap, lots of cabin space, nippy, the inside has every modern convenance, but…
Your left wondering why anyone is bothering with hot hatchbacks these days as you climb into your volvo
Debian would be a Volvo Estate, its the boring practical family choice, the owner is soneone boring like an architect or a financial advisor.
Arch is a Vauxhall Nova, second hand battered owned almost exclusively by teenage lads who spend a lot of time/money modifying it (e.g. lowering so it can’t go over speed bumps, adding a massive exhaust to sound good but destroys engine power).
Fedora is something slightly larger/more expensive like a Ford Focus/VW Golf/Vauxhall Astra owned by slightly older lads. The owners spend their time adding lighting kits and the largest sound systems money can buy.
Slackware is clearly a Subaru Impreza, at one point the best World Rally Car but hasn’t been a contender for a while. Almost all are owned by rally fans who spend fantastic amounts of time tinkering with the car to get set it up an ultimate rally car. None of the owners race cars.
OpenSuse is a Nissan Cube, its insanely practical. It should be the modern boring family choice, but it manages to ve too quirky for your architect while not practical enough for van drivers.
I don’t know the other distros well enough.
I run Debian btw
When AMD launched Ryzen they deliberately offered way more I/O bandwidth than Intel.
The first generation Ryzen CPU’s used RAM frequency that could cause performance issues if you used low frequency RAM. That got fixed in the 3000 series.
There are a small number of Ryzen CPU’s which end with “3D,” it means they had 3D Cache memory and its supposed to add rediculous performance in certain situations. Phoronix runs tons of benchmarks on CPU and GPU.
The only Intel instructions AMD haven’t implemented is AVX-512 and AVX-10. No one uses AVX-512 as Intel CPU’s get so hot they performance throttle so much its faster to not use the extension. AVX-10 is something new Intel released this year to get around that.
AMD does support AVX2 which a lot of Audio/Video products do use.
Every big UK company I have worked for doesn’t own its building. They will typically agree to rent a building for 5-20 years at a fixed rate (longer times if its being purpose built for them) .
So I would expect this is paying out the rest of the rental agreements for a building to escape the building lease.
It is to do with financial reporting and the way asset and operational costs are reported.
Uhh how?
The rate of new features/changes is far higher, uptime went through a bumpy transition but is back to normal. From an engineering perspective it supports my point.
Twitters issues are Elon scaring away advertisers/annoying governments/content creators through his hard line on free speech allowing an explosion in hate speech.
deleted by creator
Firstly it was just a bit of fun but from memory…
Twitter was listed as having 2 data centers and a couple dozen satellite offices.
I forgot the data center estimate, but most of those satelites were tiny. Google gave me the floor area for a couple and they were for 20-60 people (assuming a desk consumes 6m2 and dividing the office area by that).
Assuming an IT department of 20 for such an office is rediculous but I was trying to overestimate.
The Silicon Valley companies massively over hired.
Using twitter as an example, they used to publicly disclose every site and their entire tech stack.
I have to write proposals and estimates and when Elon decided to axe half the company of 8000 I was curious…
I assigned the biggest functional team I could (e.g. just create units of 10 and plan for 2 teams to compete on everything). I assumed a full 20 person IT department at every site, etc… Then I added 20% to my total and then 20% again for management.
I came up with an organisation of ~1200, Twitter was at 8000.
I had excluded content moderators and ad sellers because I had no experience in estimating that but it gives a idea of the problem.
I think the idea was to deny competition people but in reality that kind of staff bloat will hurt the big companies
The team/organisations knowledge is a huge factor but its easy to fall into a trap where no matter what the problem is the solution is X language.
If I have an organisation that knows C# and we need to build a Web Application. I would suggest we need to learn Node.js and Typescript and not invest in a solution that turns C# into web pages.
Technical Leads are not rational beings and lots of software is developed from an emotional stand point.
Engineering is trade offs, every technical decision you make has a pro/con.
What you should do is write out the core requirements/constraints.Then you weigh the choices to select the option that best meets it.
What actually happens is someone really likes X framework, Y programming language or Z methodology and so decides the solution and then looks for reasons to justify it.
Currently the obvious tell is if they pitch Rust. I am not saying Rust is bad, but you’ll notice they will extoll the memory safety or performance and forget about the actual requirements of the project.
It isn’t a good move.
A domain name can cost as little as £10, similarly most email services cost ~£5-£15 per person per month. Its normally pretty easy to link a domain to an email provider and doesn’t cost anything other than time.
If a company can’t be bothered to implement the most basic online branding people will make their assumptions and some will filter your company out because of it. With the cost to implement so low (e.g. £160 per year), even the loss/gain of a single customer would justify it.
Wine attempts to translate Windows calls into Linux, its developed by Codeweavers whose focus is/was application compatibility.
Valve took Wine and modify it to best support games, the result is called Proton. For example:
Someone built a library to convert DirectX 9-11 calls and turn them into Vulkan ones, it was written in C++ and is called DxVK.
Wine has strict rules on only C code and their directx library handles odd behaviour from old CAD applications.
Valve doesn’t care about that, they care that the Wine DirectX library is slow and buggy and DxVK isn’t. So they pull out Wines and use DxVK.
There are lots of smaller changes, these are ‘Proton Fixes’, sometimes Proton Fixes are passed on to Wine. Sometimes they can’t but discussion happens and a Wine fix is developed.
deleted by creator
I thought server side anti cheat was the most effective. Since it can’t be modified by clients and tracks clients for impossible behaviour.
I wish a company would build 4.5"-5.5" and 5.5"-6.5" flagship phones, put as many features that make sense in each.
Then when you release a new flagship the last flagship devices become your ‘mid range’ and you drop the price accordingly, with your mid range dropping to budget the year after.
When Nokia had 15 different phones out at a time it made sense because they would be wildly different (size, shape, button layout, etc…).
These days everyone wants as large a screen as possible on a device that is comfortable to hold, we really don’t need 15 different models with slightly different screen ratios.
I’d actually argue Python stops people learning how to solve problems.
I love teaching juniors and have done so for 10 years but I’ve noticed in the last 4-5 years since Python became the popular choice at universities Graduates aren’t learning anything about Static Types, Memory Management, Object Oriented Programming, Data Encapsulation, Composition, Service Oriented Architecture, etc…
I used to expect most graduates to have a mixed grounding in those concepts and would find excuses for them to work on a small UI projects. I would do this as it gets them used to solving a small problem and UI’s give instant feedback. As Python became dominate university teaching language the graduates aren’t spending their time learning Typescript, Angular, HTML, etc… but instead getting overwhelmed by the concept of types.
Those concepts I want them to learn were created to help make solving problems easier and each has their strengths and weaknesses but most graduates are coming through only knowing how to lay out a small amount of procedural logic using Python and really struggling to move beyond that.