Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[R] Cross-Axis Transformer with 2d Rotary Embeddings (arxiv.org)

submitted 11 months ago by lilyerickson@alien.top to c/machinelearning@academy.garden

6 comments fedilink hide all child comments

top 6 comments

sorted by: hot top controversial new old

[–] C0R0NA_CHAN@alien.top 1 points 11 months ago (1 children)

I worked on Retention too. Would you be interested in talking more?

[–] lilyerickson@alien.top 1 points 11 months ago

I suppose it depends on the topic in question. Feel free to shoot me a DM, if you'd like.

[–] lilyerickson@alien.top 1 points 11 months ago (2 children)

I hope this doesn't qualify as self promotion, I just wanted to give back to the community that's helped me so much, and hopefully offer a bit of perspective and hope for others.

So I've spent the last three decades of my life battling depression and ADHD, however about 2 years ago, I discovered AI and machine learning, and poured my heart and soul into learning all about it.

Well, fast forward to now, and I've self-published my own pre-print, with a novel model that beats other similar architectures, while boasting 2-4x larger batch sizes at the same time.

After dropping out of college ~11 years ago thanks to my untreated issues, I must say it's been quite a journey, and I'm extremely happy to be where I am today.

So, to anyone else out there who might feel that all who wander are indeed lost, I guess I hope my story can provide some inspiration.

Code can be found here: https://github.com/ElleLeonne/Cross-Axis-Transformer

[–] 314kabinet@alien.top 1 points 11 months ago

I’m so happy to hear that you’re happy :)

[–] Smallpaul@alien.top 1 points 11 months ago

That's an awesome trajectory you are on!

[–] residentmouse@alien.top 1 points 11 months ago

Very cool paper.