|
You should also read up on the use of the '.gitignore' file (period at the beginning must be there.)
You will find examples that will probably work as is for you without changing anything.
|
|
|
|
|
bad thing is that I committed it before I put up the right .gitignore file.
diligent hands rule....
|
|
|
|
|
Hi community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of businesses are starting to entertain the idea of self-hosting LLMs trained on their proprietary data rather than relying on third party APIs.
GitHub repo: https://github.com/georgian-io/LLM-Finetuning-Hub
To this point, I am tracking the following 4 pillars of evaluation that businesses are typically look into: - Performance - Time to train an LLM - Cost to train an LLM - Inference (throughput / latency / cost per token)
For each LLM, my aim is to benchmark them for popular tasks, i.e., classification and summarization. Moreover, I would like to compare them against each other.
So far, I have benchmarked Flan-T5-Large, Falcon-7B and RedPajama and have found them to be very efficient in low-data situations, i.e., when there are very few annotated samples. Llama2-7B/13B and Writer’s Palmyra are in the pipeline.
But there’s so many LLMs out there! In case this work interests you, would be great to join forces.
GitHub repo attached — feedback is always welcome
Happy hacking!
modified 9-Sep-23 15:14pm.
|
|
|
|
|
what is your use case for LLM?
diligent hands rule....
|
|
|
|
|
We have anumber of LLM's in our parish, maybe I could ask one of them.
|
|
|
|
|
more details needed. why not compare most used ones ?
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
But do any of you know what a trebuchet is?
|
|
|
|
|
Quote: trebuchet (n.)
"medieval stone-throwing engine of war," c. 1300 (in Anglo-Latin from early 13c.), from Old French trebuchet (12c.) "stone-throwing siege engine," from trabuchier "to overturn, fall to the ground, overthrow" (11c.), from tra- (from Latin trans-, here expressing "displacement") + Old French buc "trunk, bulk," from Frankish *buk- "trunk of the body," from Proto-Germanic *bheu-, variant of *beu-, used in forming words loosely associated with swelling (such as German bauch "belly;" see bull (n.2))
«The mind is not a vessel to be filled but a fire to be kindled» Plutarch
|
|
|
|
|
|
Are you just throwing that out to anyone?
|
|
|
|
|
A really cool font.
Had to throw that out there!
I don't think before I open my mouth, I like to be as surprised a everyone else.
PartsBin an Electronics Part Organizer - Release Version 1.1.0 JaxCoder.com
Latest Article: SimpleWizardUpdate
|
|
|
|
|
You either hit the target or missed by a mile.
|
|
|
|
|
Know what it is? Heck, I built one to throw water balloons for my wife. She was the teacher for the gifted kids at an Elementary (grades K through 5 in the States). She taught a unit about the Middle Ages, castles, knights, all that stuff.
My trebuchet has a 7 foot long arm and the weight was 100 pounds of sand. Made the sling from an old pair of blue jeans.
I’ve given up trying to be calm. However, I am open to feeling slightly less agitated.
I’m begging you for the benefit of everyone, don’t be STUPID.
|
|
|
|
|
OK. That's awesome.
What do you get when you cross a joke with a rhetorical question?
The metaphorical solid rear-end expulsions have impacted the metaphorical motorized bladed rotating air movement mechanism.
Do questions with multiple question marks annoy you???
|
|
|
|
|
Cool. I did that many-many moons ago. Crazy teen days.
Made one for throwing large fish bait into the surf that was too dangerous to swim in.
Worked OK, but clumsy and not very portable. These days folks use drones.
"A little time, a little trouble, your better day"
Badfinger
|
|
|
|
|
Now days one get get a very effective spinning reel with heavy line and long rod to reach deep into the surf. But the best approach are powerful programmable drones capable of delivering up to 5 lbs of bait to be auto-dropped once it has reached a programmed range from controller. It then flies back to original take off spot.
Very cool, but not legal in some places.
"A little time, a little trouble, your better day"
Badfinger
|
|
|
|
|
jmaida wrote: but not legal in some places.
So learned both of the practice and that they have now made it specifically illegal in some places (I looked up that last part.)
|
|
|
|
|
MarkTJohnson wrote: I built one to throw water balloons for my wife
eek!
First time I read that I thought it said 'at my wife'.
|
|
|
|
|
|
|
Seems like the device was also used to throw cows.
|
|
|
|
|
And a piano. (If I recall correctly.)
|
|
|
|
|
Fetchez la vache!
"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer
|
|
|
|
|
Yes, I made one. It's a medieval weapon.
"One man's wage rise is another man's price increase." - Harold Wilson
"Fireproof doesn't mean the fire will never come. It means when the fire comes that you will be able to withstand it." - Michael Simmons
"You can easily judge the character of a man by how he treats those who can do nothing for him." - James D. Miles
|
|
|
|
|
These days it is easier to just jump in your car and drive it through the front door of your neighbors house that you don't like.
Of course just like the ol' days much smarter of you to convince another neighbor that you don't like to drive their car. So you take out two at once.
|
|
|
|