top of page
Home
Demo
Comparison of running LLAMA 8B and YAICS optimized LLAMA 1B on example dialogues from SamSum dataset.
1. Low resource inference: YAICS used only 5GB of GPU RAM for inference.
2. Student outperforms teacher in quality: YAICS LLAMA 1B was trained on 100 examples generated by LLAMA 8B and generates better summaries.
dialogue | LLAMA (8B) summary | LLAMA (1B) YAICS summary |
|---|---|---|
Hannah: Hey, do you have Betty's number?
Amanda: Lemme check
Hannah: | Hannah asks Amanda for Betty's phone number, which Amanda can't find. Amanda suggests asking Larry, who recently called Betty. Hannah is hesitant but eventually agrees to text Larry. | Hannah and Amanda discuss obtaining Betty's phone number, with Amanda suggesting asking Larry due to his friendly nature. |
Eric: MACHINE!
Rob: That's so gr8!
Eric: I know! And shows how Americans see Russian ;)
Rob: And it's really funny!
Eric: I know! I especially like the train part!
Rob: Hahaha! No one talks to the machine like that!
Eric: Is this his only stand-up?
Rob: Idk. I'll check.
Eric: Sure.
Rob: Turns out no! There are some of his stand-ups on youtube.
Eric: Gr8! I'll watch them now!
Rob: Me too!
Eric: MACHINE!
Rob: MACHINE!
Eric: TTYL?
Rob: Sure :) | Eric and Rob discuss MACHINE's stand-up comedy style and YouTube availability, expressing enthusiasm to watch more of his stand-up performances. | |
Lenny: Babe, can you help me with something?
Bob: Sure, what's up?
Lenny: Which one should I pick?
Bob: Send me photos
Lenny: | Lenny asks Bob for advice on which pair of trousers to buy. Bob suggests sending photos for comparison. Lenny decides to buy the first or third pair based on quality. | Lenny asks Bob for help choosing trousers, discussing color and quality options with Bob. |
Will: hey babe, what do you want for dinner tonight?
Emma: gah, don't even worry about it tonight
Will: what do you mean? everything ok?
Emma: not really, but it's ok, don't worry about cooking though, I'm not hungry
Will: Well what time will you be home?
Emma: soon, hopefully
Will: you sure? Maybe you want me to pick you up?
Emma: no no it's alright. I'll be home soon, i'll tell you when I get home.
Will: Alright, love you.
Emma: love you too. | Will asks Emma about dinner, but she declines and says she's not hungry. Will offers to pick her up, but she declines and says she'll be home soon. | Will and Emma discuss dinner plans, Emma's emotional state, and Will's concern for her, expressing love and care for each other. |
Ollie: Hi , are you in Warsaw
Jane: yes, just back! Btw are you free for diner the 19th?
Ollie: nope!
Jane: and the 18th?
Ollie: nope, we have this party and you must be there, remember?
Jane: oh right! i lost my calendar.. thanks for reminding me
Ollie: we have lunch this week?
Jane: with pleasure!
Ollie: friday?
Jane: ok
Jane: what do you mean " we don't have any more whisky!" lol..
Ollie: what!!!
Jane: you just call me and the all thing i heard was that sentence about whisky... what's wrong with you?
Ollie: oh oh... very strange! i have to be carefull may be there is some spy in my mobile! lol
Jane: dont' worry, we'll check on friday.
Ollie: don't forget to bring some sun with you
Jane: I can't wait to be in Morocco..
Ollie: enjoy and see you friday
Jane: sorry Ollie, i'm very busy, i won't have time for lunch tomorrow, but may be at 6pm after my courses?this trip to Morocco was so nice, but time consuming!
Ollie: ok for tea!
Jane: I'm on my way..
Ollie: tea is ready, did you bring the pastries?
Jane: I already ate them all... see you in a minute
Ollie: ok | Ollie and Jane discuss dinner plans, a party, and a trip to Morocco. They make plans for lunch and tea. | Jane and Ollie discuss dinner, party, lunch, whisky, and a Morocco trip, scheduling and joking about their plans and invitations. |
Benjamin: Hey guys, what are we doing with the keys today?
Hilary: I've got them. Whoever wants them can meet me at lunchtime or after
Elliot: I'm ok. We're meeting for the drinks in the evening anyway and I guess we'll be going back to the apartment together?
Hilary: Yeah, I guess so
Daniel: I'm with Hilary atm and won't let go of her for the rest of the day, so any option you guys choose is good for me
Benjamin: Hmm I might actually pass by at lunchtime, take the keys and go take a nap. I'm sooo tired after yesterday
Hilary: Sounds good. We'll be having lunch with some French people (the ones who work on the history of food in colonial Mexico - I already see you yawning your head off)
Benjamin: YAAAAWN 🙊 Where and where are you meeting?
Hilary: So I'm meeting them at the entrance to the conference hall at 2 pm and then we'll head to this place called La Cantina. Italian cuisine, which is quite funny, but that's what they've chosen
Benjamin: Interesting 😱 To be honest, Hilary, I almost feel like changing my mind. Wanting to take this nap might end up costing me to dear
Hilary: Oh come on 😂
Benjamin: All these terrible obstacles on mu way to bed might just prove to much to take
Hilary: We'll try to avoid talking about their subject of research. Oh wait, no, I'm actually meeting them because I wanted to chat about their research lol
Elliot: 🙉
Hilary: Do join us, we're going to have fun. And then you'll take the keys and take this most deserved of naps
Elliot: Sounds like a plan 😂
Hilary: 😎
Elliot: See you at 2 then xx | Benjamin wants to take a nap and asks if he can meet Hilary at lunchtime to pick up keys. Hilary agrees, but also invites Benjamin to join her for lunch with some French researchers. | Hilary will give keys to someone at lunch or after, then meet French researchers at the conference hall and go to La Cantina. |
Max: Know any good sites to buy clothes from?
Payton: Sure :) | Max asks Payton for good clothing sites, and Payton shares several options. Max thanks Payton and asks about her shopping habits. Payton enjoys browsing but doesn't always buy, citing financial constraints. Max relates to this and they discuss their shared struggles with resisting purchases. Payton reveals she has a weakness for clothes and books. | Max and Payton discuss clothes shopping, online stores, and reading habits, with Payton sharing her love for browsing and reading. |
Rita: I'm so bloody tired. Falling asleep at work. :-(
Tina: I know what you mean.
Tina: I keep on nodding off at my keyboard hoping that the boss doesn't notice..
Rita: The time just keeps on dragging on and on and on....
Rita: I keep on looking at the clock and there's still 4 hours of this drudgery to go.
Tina: Times like these I really hate my work.
Rita: I'm really not cut out for this level of boredom.
Tina: Neither am I. | Rita and Tina express their frustration and boredom at work. | Rita and Tina share their boredom and frustration at work, struggling to stay awake and feeling mismatched in their roles. |
Beatrice: I am in town, shopping. They have nice scarfs in the shop next to the church. Do you want one?
Leo: No, thanks
Beatrice: But you don't have a scarf.
Leo: Because I don't need it.
Beatrice: Last winter you had a cold all the time. A scarf could help.
Leo: I don't like them.
Beatrice: Actually, I don't care. You will get a scarf.
Leo: How understanding of you!
Beatrice: You were complaining the whole winter that you're going to die. I've had enough.
Leo: Eh. | Beatrice tries to buy Leo a scarf, but he refuses. Beatrice is frustrated with Leo's past complaints about being cold. Beatrice buys Leo a scarf anyway. | Beatrice suggests Leo gets a scarf, which he declines, leading to a sarcastic comment about his health. |
Ivan: hey eric
Eric: yeah man
Ivan: so youre coming to the wedding
Eric: your brother's
Ivan: yea
Eric: i dont know mannn
Ivan: YOU DONT KNOW??
Eric: i just have a lot to do at home, plus i dont know if my parents would let me
Ivan: ill take care of your parents
Eric: youre telling me you have the guts to talk to them XD
Ivan: thats my problem
Eric: okay man, if you say so
Ivan: yea just be there
Eric: alright | Ivan asks Eric to attend his brother's wedding, but Eric is hesitant due to prior commitments and parental concerns. Ivan offers to handle the situation with Eric's parents. Eric agrees to attend the wedding. | Ivan invites Eric to his wedding, Eric hesitates, Ivan offers to discuss with Eric's parents, and Eric agrees to attend. |
The only agent you'll ever need. It creates and manages on-prem agents, offering elite LLM performance at a fraction of the cost
Why you should use it:
1. By only providing initial prompt you outsource prompt fine tuning and optimization to YAICS agent.
2. YAICS need ~100 example inputs to build an lightweight optimized model.
bottom of page