Ask Lemmy

35125 readers

2583 users here now

A Fediverse community for open-ended, thought provoking questions

Rules: (interactive)

1) Be nice and; have fun

Doxxing, trolling, sealioning, racism, and toxicity are not welcomed in AskLemmy. Remember what your mother said: if you can't say something nice, don't say anything at all. In addition, the site-wide Lemmy.world terms of service also apply here. Please familiarize yourself with them

2) All posts must end with a '?'

This is sort of like Jeopardy. Please phrase all post titles in the form of a proper question ending with ?

3) No spam

Please do not flood the community with nonsense. Actual suspected spammers will be banned on site. No astroturfing.

4) NSFW is okay, within reason

Just remember to tag posts with either a content warning or a [NSFW] tag. Overtly sexual posts are not allowed, please direct them to either !asklemmyafterdark@lemmy.world or !asklemmynsfw@lemmynsfw.com. NSFW comments should be restricted to posts tagged [NSFW].

5) This is not a support community.

It is not a place for 'how do I?', type questions. If you have any questions regarding the site itself or would like to report a community, please direct them to Lemmy.world Support or email info@lemmy.world. For other questions check our partnered communities list, or use the search function.

6) No US Politics.

Please don't post about current US Politics. If you need to do this, try !politicaldiscussion@lemmy.world or !askusa@discuss.online

Reminder: The terms of service apply here too.

Partnered Communities:

Logo design credit goes to: tubbadu

founded 2 years ago

MODERATORS

Bluetreefrog@lemmy.world

TheSaneWriter@lemm.ee

TheSaneWriter@lemmy.thesanewriter.com

Asudox@lemmy.world

lemmy_bot@lemmy.world

beefbaby182@lemmy.world

ModeratorCan@lemmy.world

neidu3@sh.itjust.works

asudox@lemmy.asudox.dev

candyman337@lemmy.world

candyman337@sh.itjust.works

187

What do all you coders actually do? (sh.itjust.works)

submitted 1 day ago by bridgeenjoyer@sh.itjust.works to c/asklemmy@lemmy.world

132 comments fedilink hide all child comments

I have tried for 20 years to get into coding, and among adhd and having 10 million other projects going on, just could never get it beyond absolute basics and knowing some differences between languages.

Now it seems every tutorial I see is really just clicking around in a gui. Very little actual typing of code, which is the part I actually find cool and interesting.

So my question is, since everyone on lemmy is a programmer, what do you guys actually do? Is it copying and pasting tons of code? Is it fixing small bugs in Java for a website like "the drop down field isn't loading properly on this form"?

I just dont get what "a full stack developer sufficient in sql and python" actually does. Also i dont know if that sentence even made sense!

you are viewing a single comment's thread
view the rest of the comments

[–] dream_weasel@sh.itjust.works 3 points 15 hours ago

My last project is using machine learning to sort data for a company and the flow kinda goes like this:

Use the advanced tab in the browser on the UI search pagr for the company to expose the API query for the data I want to have
Write some shell script to programmatically call the API for the data I want.
Realize that there's actually a limit to how much data the API can return BUT the metadata says how much there is beyond the limit.
Write some script to paginate (scrape over) all that data and save as a JSON file
Realize my JSON is badly formatted and some queries are empty, so do some error checking and massage to make it work right.
Create a python script to ingest the parts of the saved data I want and write it to a SQLite database. This takes ongoing refinement.
Do some sql to count how many entries I got in the time period I was getting data for, and compare to a tool the company has to aggregate said data. It was close enough.
Go learn about Jaccard similarity and locality sensitive hashing. Use this to write a script to deduplicate the database so I don't have a zillion repeated entries. Also python, but it starts with some cursor stuff and sql.
Do the actual project which is trying to get some reinforcement learning to label the data automagically. This means I also have to write some methods to get particular mixes of the data I've already collected. For example I want my mix to have 50 percent red balls, 20 percent green balls and 30 percent blue balls. How do you pick the right number of balls from the total set? It's not hard but it takes some thinking.
Wrap this thing up in a script that will do some load balancing on a machine with lots of gpus and CPUs so I don't hog the entire server rack. Submit it and let it cook.
Write it again so I can wrap options around it and optimize hyperparameters.
Start working up the results to show improvement overall. If it's better than what the company already has...
Time to fire up the old git repo and make sure the commits are clean. Add readme and make files (bc I prefer to deploy with make) and put it in the hands of another engineer who will roll it out for that company.

Idk it's not a super sophisticated problem but it has a lot of moving parts and you have to kind of tackle them in order. Mostly it's "hey here's an obstacle to the end goal, how do I fix it on my own in a smart way?"

Then do it.