학술논문

Gemini: A Family of Highly Capable Multimodal Models
Document Type
Working Paper
Author
Gemini TeamAnil, RohanBorgeaud, SebastianAlayrac, Jean-BaptisteYu, JiahuiSoricut, RaduSchalkwyk, JohanDai, Andrew M.Hauth, AnjaMillican, KatieSilver, DavidJohnson, MelvinAntonoglou, IoannisSchrittwieser, JulianGlaese, AmeliaChen, JilinPitler, EmilyLillicrap, TimothyLazaridou, AngelikiFirat, OrhanMolloy, JamesIsard, MichaelBarham, Paul R.Hennigan, TomLee, BenjaminViola, FabioReynolds, MalcolmXu, YuanzhongDoherty, RyanCollins, EliMeyer, ClemensRutherford, ElizaMoreira, EricaAyoub, KareemGoel, MeghaKrawczyk, JackDu, CosmoChi, EdCheng, Heng-TzeNi, EricShah, PurviKane, PatrickChan, BettyFaruqui, ManaalSeveryn, AliakseiLin, HanzhaoLi, YaGuangCheng, YongIttycheriah, AbeMahdieh, MahdisChen, MiaSun, PeiTran, DustinBagri, SumitLakshminarayanan, BalajiLiu, JeremiahOrban, AndrasGüra, FabianZhou, HaoSong, XinyingBoffy, AurelienGanapathy, HarishZheng, StevenChoe, HyunJeongWeisz, ÁgostonZhu, TaoLu, YifengGopal, SiddharthKahn, JarrodKula, MaciejPitman, JeffShah, RushinTaropa, EmanuelMerey, Majd AlBaeuml, MartinChen, ZhifengShafey, Laurent ElZhang, YujingSercinoglu, OlcanTucker, GeorgePiqueras, EnriqueKrikun, MaximBarr, IainSavinov, NikolayDanihelka, IvoRoelofs, BeccaWhite, AnaïsAndreassen, Andersvon Glehn, TamaraYagati, LakshmanKazemi, MehranGonzalez, LucasKhalman, MishaSygnowski, JakubFrechette, AlexandreSmith, CharlotteCulp, LauraProleev, LevLuan, YiChen, XiLottes, JamesSchucher, NathanLebron, FedericoRrustemi, AlbanClay, NatalieCrone, PhilKocisky, TomasZhao, JeffreyPerz, BartekYu, DianHoward, HeidiBloniarz, AdamRae, Jack W.Lu, HanSifre, LaurentMaggioni, MarcelloAlcober, FredGarrette, DanBarnes, MeganThakoor, ShantanuAustin, JacobBarth-Maron, GabrielWong, WilliamJoshi, RishabhChaabouni, RahmaFatiha, DeeniAhuja, ArunTomar, Gaurav SinghSenter, EvanChadwick, MartinKornakov, IlyaAttaluri, NithyaIturrate, IñakiLiu, RuiboLi, YunxuanCogan, SarahChen, JeremyJia, ChaoGu, ChenjieZhang, QiaoGrimstad, JordanHartman, Ale JakseGarcia, XavierPillai, Thanumalayan SankaranarayanaDevlin, JacobLaskin, MichaelCasas, Diego de LasValter, DashaTao, ConnieBlanco, LorenzoBadia, Adrià PuigdomènechReitter, DavidChen, MiannaBrennan, JennyRivera, ClaraBrin, SergeyIqbal, ShariqSurita, GabrielaLabanowski, JaneRao, AbhiWinkler, StephanieParisotto, EmilioGu, YimingOlszewska, KateAddanki, RaviMiech, AntoineLouis, AnnieTeplyashin, DenisBrown, GeoffCatt, ElliotBalaguer, JanXiang, JackieWang, PidongAshwood, ZoeBriukhov, AntonWebson, AlbertGanapathy, SanjaySanghavi, SmitKannan, AjayChang, Ming-WeiStjerngren, AxelDjolonga, JosipSun, YutingBapna, AnkurAitchison, MatthewPejman, PedramMichalewski, HenrykYu, TianheWang, CindyLove, JulietteAhn, JunwhanBloxwich, DawnHan, KehangHumphreys, PeterSellam, ThibaultBradbury, JamesGodbole, VarunSamangooei, SinaDamoc, BogdanKaskasoli, AlexArnold, Sébastien M. R.Vasudevan, VijayAgrawal, ShubhamRiesa, JasonLepikhin, DmitryTanburn, RichardSrinivasan, SrivatsanLim, HyeontaekHodkinson, SarahShyam, PranavFerret, JohanHand, StevenGarg, AnkushPaine, Tom LeLi, JianLi, YujiaGiang, MinhNeitz, AlexanderAbbas, ZaheerYork, SarahReid, MachelCole, ElizabethChowdhery, AakankshaDas, DipanjanRogozińska, DominikaNikolaev, VitaliySprechmann, PabloNado, ZacharyZilka, LukasProst, FlavienHe, LuhengMonteiro, MarianneMishra, GauravWelty, ChrisNewlan, JoshJia, DaweiAllamanis, MiltiadisHu, Clara Huiyide Liedekerke, RaoulGilmer, JustinSaroufim, CarlRijhwani, ShrutiHou, ShaoboShrivastava, DishaBaddepudi, AnirudhGoldin, AlexOzturel, AdnanCassirer, AlbinXu, YunhanSohn, DanielSachan, DevendraAmplayo, Reinald KimSwanson, CraigPetrova, DessieNarayan, ShashiGuez, ArthurBrahma, SiddharthaLandon, JessicaPatel, MiteyanZhao, RuizheVillela, KevinWang, LuyuJia, WenhaoRahtz, MatthewGiménez, MaiYeung, LeggKeeling, JamesGeorgiev, PetkoMincu, DianaWu, BoxiHaykal, SalemSaputro, RachelVodrahalli, KiranQin, JamesCankara, ZeynepSharma, AbhanshuFernando, NickHawkins, WillNeyshabur, BehnamKim, SolomonHutter, AdrianAgrawal, PriyankaCastro-Ros, AlexDriessche, George van denWang, TaoYang, FanChang, Shuo-yiinKomarek, PaulMcIlroy, RossLučić, MarioZhang, GuodongFarhan, WaelSharman, MichaelNatsev, PaulMichel, PaulBansal, YaminiQiao, SiyuanCao, KrisShakeri, SiamakButterfield, ChristinaChung, JustinRubenstein, Paul KishanAgrawal, ShivaniMensch, ArthurSoparkar, KedarLenc, KarelChung, TimothyPope, AedanMaggiore, LorenKay, JackieJhakra, PriyaWang, ShiboMaynez, JoshuaPhuong, MaryTobin, TaylorTacchetti, AndreaTrebacz, MajaRobinson, KevinKatariya, YashRiedel, SebastianBailey, PaigeXiao, KefanGhelani, NimeshAroyo, LoraSlone, AmbroseHoulsby, NeilXiong, XuehanYang, ZhenGribovskaya, ElenaAdler, JonasWirth, MateoLee, LisaLi, MusicKagohara, ThaisPavagadhi, JayBridgers, SophieBortsova, AnnaGhemawat, SanjayAhmed, ZafaraliLiu, TianqiPowell, RichardBolina, VijayIinuma, MarikoZablotskaia, PolinaBesley, JamesChung, Da-WoonDozat, TimothyComanescu, RamonaSi, XianceGreer, JeremySu, GuolongPolacek, MartinKaufman, Raphaël LopezTokumine, SimonHu, HexiangBuchatskaya, ElenaMiao, YingjieElhawaty, MohamedSiddhant, AdityaTomasev, NenadXing, JinweiGreer, ChristinaMiller, HelenAshraf, ShereenRoy, AurkoZhang, ZizhaoMa, AdaFilos, AngelosBesta, MilosBlevins, RoryKlimenko, TedYeh, Chih-KuanChangpinyo, SoravitMu, JiaqiChang, OscarPajarskas, MantasMuir, CarrieCohen, VeredLan, Charline LeHaridasan, KrishnaMarathe, AmitHansen, StevenDouglas, SholtoSamuel, RajkumarWang, MingqiuAustin, SophiaLan, ChangJiang, JiepuChiu, JustinLorenzo, Jaime AlonsoSjösund, Lars LoweCevey, SébastienGleicher, ZachAvrahami, ThiBoral, AnudhyanSrinivasan, HansaSelo, VittorioMay, RhysAisopos, KonstantinosHussenot, LéonardSoares, Livio BaldiniBaumli, KateChang, Michael B.Recasens, AdriàCaine, BenPritzel, AlexanderPavetic, FilipPardo, FabioGergely, AnitaFrye, JustinRamasesh, VinayHorgan, DanBadola, KartikeyaKassner, NoraRoy, SubhrajitDyer, EthanCampos, Víctor CamposTomala, AlexTang, YunhaoBadawy, Dalia ElWhite, ElspethMustafa, BasilLang, OranJindal, AbhishekVikram, SharadGong, ZhitaoCaelles, SergiHemsley, RossThornton, GregoryFeng, FangxiaoyuStokowiec, WojciechZheng, CeThacker, PhoebeÜnlü, ÇağlarZhang, ZhishuaiSaleh, MohammadSvensson, JamesBileschi, MaxPatil, PiyushAnand, AnkeshRing, RomanTsihlas, KaterinaVezer, ArpiSelvi, MarcoShevlane, TobyRodriguez, MikelKwiatkowski, TomDaruki, SamiraRong, KeranDafoe, AllanFitzGerald, NicholasGu-Lemberg, KerenKhan, MinaHendricks, Lisa AnnePellat, MarieFeinberg, VladimirCobon-Kerr, JamesSainath, TaraRauh, MaribethHashemi, Sayed HadiIves, RichardHasson, YanaNoland, EricCao, YuanByrd, NathanHou, LeWang, QingzeSottiaux, ThibaultPaganini, MichelaLespiau, Jean-BaptisteMoufarek, AlexandreHassan, SamerShivakumar, Kaushikvan Amersfoort, JoostMandhane, AmolJoshi, PratikGoyal, AnirudhTung, MatthewBrock, AndrewSheahan, HannahMisra, VedantLi, ChengRakićević, NemanjaDehghani, MostafaLiu, FangyuMittal, SidOh, JunhyukNoury, SebSezener, ErenHuot, FantineLamm, MatthewDe Cao, NicolaChen, CharlieMudgal, SidharthStella, RominaBrooks, KevinVasudevan, GautamLiu, ChenxiChain, MainakMelinkeri, NiveditaCohen, AaronWang, VenusSeymore, KristieZubkov, SergeyGoel, RahulYue, SummerKrishnakumaran, SaiAlbert, BrianHurley, NateSano, MotokiMohananey, AnhadJoughin, JonahFilonov, EgorKępa, TomaszEldawy, YomnaLim, JiawernRishi, RahulBadiezadegan, ShirinBos, TaylorChang, JerryJain, SanilPadmanabhan, Sri Gayatri SundaraPuttagunta, SubhaKrishna, KalpeshBaker, LeslieKalb, NorbertBedapudi, VamsiKurzrok, AdamLei, ShuntongYu, AnthonyLitvin, OrenZhou, XiangWu, ZhichunSobell, SamSiciliano, AndreaPapir, AlanNeale, RobbyBragagnolo, JonasToor, TejChen, TinaAnklin, ValentinWang, FeiranFeng, RichieGholami, MiladLing, KevinLiu, LijuanWalter, JulesMoghaddam, HamidKishore, ArunAdamek, JakubMercado, TylerMallinson, JonathanWandekar, SiddhinitaCagle, StephenOfek, EranGarrido, GuillermoLombriser, ClemensMukha, MaksimSun, BotuMohammad, Hafeezul RahmanMatak, JosipQian, YadiPeswani, VikasJanus, PawelYuan, QuanSchelin, LeifDavid, OanaGarg, AnkurHe, YifanDuzhyi, OleksiiÄlgmyr, AntonLottaz, TimothéeLi, QiYadav, VikasXu, LuyaoChinien, AlexShivanna, RakeshChuklin, AleksandrLi, JosieSpadine, CarrieWolfe, TravisMohamed, KareemDas, SubhabrataDai, ZihangHe, Kylevon Dincklage, DanielUpadhyay, ShyamMaurya, AkankshaChi, LuyanKrause, SebastianSalama, KhalidRabinovitch, Pam GM, Pavan Kumar ReddySelvan, AarushDektiarev, MikhailGhiasi, GolnazGuven, ErdemGupta, HimanshuLiu, BoyiSharma, DeepakShtacher, Idan HeimlichPaul, ShachiAkerlund, OscarAubet, François-XavierHuang, TerryZhu, ChenZhu, EricTeixeira, ElicoFritze, MatthewBertolini, FrancescoMarinescu, Liana-EleonoraBölle, MartinPaulus, DominikGupta, KhyattiLatkar, TejasiChang, MaxSanders, JasonWilson, RoopaWu, XueweiTan, Yi-XuanThiet, Lam NguyenDoshi, TulseeLall, SidMishra, SwaroopChen, WanmingLuong, ThangBenjamin, SethLee, JasmineAndrejczuk, EwaRabiej, DominikRanjan, VipulStyrc, KrzysztofYin, PengchengSimon, JonHarriott, Malcolm RoseBansal, MuditRobsky, AlexeiBacon, GeoffGreene, DavidMirylenka, DaniilZhou, ChenSarvana, ObaidGoyal, AbhimanyuAndermatt, SamuelSiegler, PatrickHorn, BenIsrael, AssafPongetti, FrancescoChen, Chih-Wei "Louis"; Selvatici, MarcoSilva, PedroWang, KathieTolins, JacksonGuu, KelvinYogev, RoeyCai, XiaochenAgostini, AlessandroShah, MaulikNguyen, HungDonnaile, Noah ÓPereira, SébastienFriso, LindaStambler, AdamKuang, ChenkaiRomanikhin, YanGeller, MarkYan, ZJJang, KaneLee, Cheng-ChunFica, WojciechMalmi, EricTan, QijunBanica, DanBalle, DanielPham, RyanHuang, YanpingAvram, DianaShi, HongzhiSingh, JasjotHidey, ChrisAhuja, NiharikaSaxena, PranabDooley, DanPotharaju, Srividya PranaviO'Neill, EileenGokulchandran, AnandFoley, RyanZhao, KaiDusenberry, MikeLiu, YuanMehta, PulkitKotikalapudi, RaghaSafranek-Shrader, ChalenceGoodman, AndrewKessinger, JoshuaGloben, EranKolhar, PrateekGorgolewski, ChrisIbrahim, AliSong, YangEichenbaum, AliBrovelli, ThomasPotluri, SahityaLahoti, PreethiBaetu, CipGhorbani, AliChen, CharlesCrawford, AndyPal, ShaliniSridhar, MukundGurita, PetruMujika, AsierPetrovski, IgorCedoz, Pierre-LouisLi, ChenmeiChen, ShiyuanSanto, Niccolò DalGoyal, SiddharthPunjabi, JiteshKappaganthu, KarthikKwak, ChesterLV, PallaviVelury, SarmishtaChoudhury, HimadriHall, JamieShah, PremalFigueira, RicardoThomas, MattLu, MinjieZhou, TingKumar, ChintuJurdi, ThomasChikkerur, SharatMa, YenaiYu, AdamsKwak, SooÄhdel, VictorRajayogam, SujeevanChoma, TravisLiu, FeiBarua, AdityaJi, ColinPark, Ji HoHellendoorn, VincentBailey, AlexBilal, TaylanZhou, HuanjieKhatir, MehrdadSutton, CharlesRzadkowski, WojciechMacintosh, FionaShagin, KonstantinMedina, PaulLiang, ChenZhou, JinjingShah, PararthBi, YingyingDankovics, AttilaBanga, ShipraLehmann, SabineBredesen, MarissaLin, ZifanHoffmann, John EricLai, JonathanChung, RaynaldYang, KaiBalani, NihalBražinskas, ArthurSozanschi, AndreiHayes, MatthewAlcalde, Héctor FernándezMakarov, PeterChen, WillStella, AntonioSnijders, LiselotteMandl, MichaelKärrman, AnteNowak, PawełWu, XinyiDyck, AlexVaidyanathan, KrishnanR, RaghavenderMallet, JessicaRudominer, MitchJohnston, EricMittal, SushilUdathu, AkhilChristensen, JanaraVerma, VishalIrving, ZachSantucci, AndreasElsayed, GamaleldinDavoodi, ElnazGeorgiev, MarinTenney, IanHua, NanCideron, GeoffreyLeurent, EdouardAlnahlawi, MahmoudGeorgescu, IonutWei, NanZheng, IvyScandinaro, DylanJiang, HeinrichSnoek, JasperSundararajan, MukundWang, XuezhiOntiveros, ZackKaro, ItayCole, JeremyRajashekhar, VinuTumeh, LaraBen-David, EyalJain, RishubUesato, JonathanDatta, RominaBunyan, OskarWu, ShimuZhang, JohnStanczyk, PiotrZhang, YeSteiner, DavidNaskar, SubhajitAzzam, MichaelJohnson, MatthewPaszke, AdamChiu, Chung-ChengElias, Jaume SanchezMohiuddin, AfrozMuhammad, FaizanMiao, JinLee, AndrewVieillard, NinoPark, JaneZhang, JiagengStanway, JeffGarmon, DrewKarmarkar, AbhijitDong, ZheLee, JongKumar, AviralZhou, LuoweiEvens, JonathanIsaac, WilliamIrving, GeoffreyLoper, EdwardFink, MichaelArkatkar, IshaChen, NanxinShafran, IzhakPetrychenko, IvanChen, ZheJia, JohnsonLevskaya, AnselmZhu, ZhenkaiGrabowski, PeterMao, YuMagni, AlbertoYao, KaishengSnaider, JavierCasagrande, NormanPalmer, EvanSuganthan, PaulCastaño, AlfonsoGiannoumis, IreneKim, WooyeolRybiński, MikołajSreevatsa, AshwinPrendki, JenniferSoergel, DavidGoedeckemeyer, AdrianGierke, WilliJafari, MohsenGaba, MeenuWiesner, JeremyWright, Diana GageWei, YawenVashisht, HarshaKulizhskaya, YanaHoover, JayLe, MaigoLi, LuIwuanyanwu, ChimezieLiu, LuRamirez, KevinKhorlin, AndreyCui, AlbertLIN, TianWu, MarcusAguilar, RicardoPallo, KeithChakladar, AbhishekPerng, GingerAbellan, Elena AllicaZhang, MingyangDasgupta, IshitaKushman, NatePenchev, IvoRepina, AlenaWu, Xihuivan der Weide, TomPonnapalli, PriyaKaplan, CarolineSimsa, JiriLi, ShuangfengDousse, OlivierPiper, JeffIe, NathanPasumarthi, RamaLintz, NathanVijayakumar, AnithaAndor, DanielValenzuela, PedroLui, MinniePaduraru, CosminPeng, DaiyiLee, KatherineZhang, ShuyuanGreene, SomerNguyen, Duc DungKurylowicz, PaulaHardin, CassidyDixon, LucasJanzer, LiliChoo, KiamFeng, ZiqiangZhang, BiaoSinghal, AchintyaDu, DayouMcKinnon, DanAntropova, NatashaBolukbasi, TolgaKeller, OrgadReid, DavidFinchelstein, DanielRaad, Maria AbiCrocker, RemiHawkins, PeterDadashi, RobertGaffney, ColinFranko, KenBulanova, AnnaLeblond, RémiChung, ShirleyAskham, HarryCobo, Luis C.Xu, KelvinFischer, FelixXu, JunSorokin, ChristinaAlberti, ChrisLin, Chu-ChengEvans, ColinDimitriev, AlekForbes, HannahBanarse, DylanTung, ZoraOmernick, MarkBishop, ColtonSterneck, RachelJain, RohanXia, JiaweiAmid, EhsanPiccinno, FrancescoWang, XingyuBanzal, PraseemMankowitz, Daniel J.Polozov, AlexKrakovna, VictoriaBrown, SashaBateni, MohammadHosseinDuan, DennisFiroiu, VladThotakuri, MeghanaNatan, TomGeist, MatthieuGirgin, Ser tanLi, HuiYe, JiayuRoval, OfirTojo, ReikoKwong, MichaelLee-Thorp, JamesYew, ChristopherSinopalnikov, DanilaRamos, SabelaMellor, JohnSharma, AbhishekWu, KathyMiller, DavidSonnerat, NicolasVnukov, DenisGreig, RoryBeattie, JenniferCaveness, EmilyBai, LibinEisenschlos, JulianKorchemniy, AlexTsai, TomyJasarevic, MimiKong, WeizeDao, PhuongZheng, ZeyuLiu, FrederickZhu, RuiTeh, Tian HueySanmiya, JasonGladchenko, EvgenyTrdin, NejcToyama, DanielRosen, EvanTavakkol, SasanXue, LintingElkind, ChenWoodman, OliverCarpenter, JohnPapamakarios, GeorgeKemp, RupertKafle, SushantGrunina, TanyaSinha, RishikaTalbert, AliceWu, DianeOwusu-Afriyie, DeneseThornton, ChloePont-Tuset, JordiNarayana, PradyumnaLi, JingFatehi, SaaberWieting, JohnAjmeri, OmarUria, BenignoKo, YeongilKnight, LauraHéliou, AmélieNiu, NingGu, ShanePang, ChenxiLi, YeqingLevine, NirStolovich, ArielSantamaria-Fernandez, RebecaGoenka, SonamYustalim, WennyStrudel, RobinElqursh, AliDeck, CharlieLee, HyoLi, ZonglinLevin, KyleHoffmann, RaphaelHoltmann-Rice, DanBachem, OlivierArora, ShoKoh, ChristyYeganeh, Soheil HassasPõder, SiimTariq, MukarramSun, YanhuaIonita, LucianSeyedhosseini, MojtabaTafti, PouyaLiu, ZhiyuGulati, AnmolLiu, JasmineYe, XinyuChrzaszcz, BartWang, LilySethi, NikhilLi, TianrunBrown, BenSingh, ShreyaFan, WeiParisi, AaronStanton, JoeKoverkathu, VinodChoquette-Choo, Christopher A.Li, YunjieLu, TJShroff, PrakashVaradarajan, ManiBahargam, SanazWilloughby, RobGaddy, DavidDesjardins, GuillaumeCornero, MarcoRobenek, BronaMittal, BhavishyaAlbrecht, BenShenoy, AshishMoiseev, FedorJacobsson, HenrikGhaffarkhah, AlirezaRivière, MorganeWalton, AlannaCrepy, ClémentParrish, AliciaZhou, ZongweiFarabet, ClementRadebaugh, CareySrinivasan, Praveenvan der Salm, ClaudiaFidjeland, AndreasScellato, SalvatoreLatorre-Chimoto, EriKlimczak-Plucińska, HannaBridson, Davidde Cesare, DarioHudson, TomMendolicchio, PiermariaWalker, LexiMorris, AlexMauger, MatthewGuseynov, AlexeyReid, AlisonOdoom, SethLoher, LuciaCotruta, VictorYenugula, MadhaviGrewe, DominikPetrushkina, AnastasiaDuerig, TomSanchez, AntonioYadlowsky, SteveShen, AmyGloberson, AmirWebb, LynetteDua, SahilLi, DongBhupatiraju, SuryaHurt, DanQureshi, HaroonAgarwal, AnanthShani, TomerEyal, MatanKhare, AnujBelle, Shreyas RammohanWang, LeiTekur, ChetanKale, Mihir SanjayWei, JinliangSang, RuoxinSaeta, BrennanLiechty, TylerSun, YiZhao, YaoLee, StephanNayak, PanduFritz, DougVuyyuru, Manish ReddyAslanides, JohnVyas, NidhiWicke, MartinMa, XiaoEltyshev, EvgeniiMartin, NinaCate, HardieManyika, JamesAmiri, KeyvanKim, YelinXiong, XiKang, KaiLuisier, FlorianTripuraneni, NileshMadras, DavidGuo, MandyWaters, AustinWang, OliverAinslie, JoshuaBaldridge, JasonZhang, HanPruthi, GarimaBauer, JakobYang, FengMansour, RihamGelman, JasonXu, YangPolovets, GeorgeLiu, JiCai, HonglongChen, WarrenSheng, XiangHaiXue, EmilyOzair, SherjilAngermueller, ChristofLi, XiaoweiSinha, AnoopWang, WeirenWiesinger, JuliaKoukoumidis, EmmanouilTian, YuanIyer, AnandGurumurthy, MadhuGoldenson, MarkShah, ParasharBlake, MKYu, HongkunUrbanowicz, AnthonyPalomaki, JennimariaFernando, ChrisanthaDurden, KenMehta, HarshMomchev, NikolaRahimtoroghi, ElaheGeorgaki, MariaRaul, AmitRuder, SebastianRedshaw, MorganLee, JinhyukZhou, DennyJalan, KomalLi, DinghuaHechtman, BlakeSchuh, ParkerNasr, MiladMilan, KieranMikulik, VladimirFranco, JulianaGreen, TimNguyen, NamKelley, JoeMahendru, AromaHu, AndreaHowland, JoshuaVargas, BenHui, JeffreyBansal, KshitijRao, VikramGhiya, RakeshWang, EmmaYe, KeSarr, Jean MichelPreston, Melanie MoranskiElish, MadeleineLi, SteveKaku, AakashGupta, JigarPasupat, IceJuan, Da-ChengSomeswar, MilanM., TejviChen, XinyunAmini, AidaFabrikant, AlexChu, EricDong, XuanyiMuthal, AmrutaButhpitiya, SenakaJauhari, SarthakKhandelwal, UrvashiHitron, AyalRen, JieRinaldi, LarissaDrath, ShaharDabush, AvigailJiang, Nan-JiangGodhia, HarshalSachs, UliChen, AnthonyFan, YichengTaitelbaum, HagaiNoga, HilaDai, ZhuyunWang, JamesHamer, JennyFerng, Chun-SungElkind, ChenelAtias, AvielLee, PaulinaListík, VítCarlen, Mathiasvan de Kerkhof, JanPikus, MarcinZaher, KrunoslavMüller, PaulZykova, SashaStefanec, RichardGatsko, VitalyHirnschall, ChristophSethi, AshwinXu, Xingyu FedericoAhuja, ChetanTsai, BethStefanoiu, AncaFeng, BoDhandhania, KeshavKatyal, ManishGupta, AkshayParulekar, AtharvaPitta, DivyaZhao, JingBhatia, VivaanBhavnani, YashodhaAlhadlaq, OmarLi, XiaolinDanenberg, PeterTu, DennisPine, AlexFilippova, VeraGhosh, AbhipsoLimonchik, BenUrala, BhargavaLanka, Chaitanya KrishnaClive, DerikLi, EdwardWu, HaoHongtongsak, KevinLi, IannaThakkar, KalindOmarov, KuanyshMajmundar, KushalAlverson, MichaelKucharski, MichaelPatel, MohakJain, MuditZabelin, MaksimPelagatti, PaoloKohli, RohanKumar, SaurabhKim, JosephSankar, SwethaShah, VineetRamachandruni, LakshmiZeng, XiangkaiBariach, BenWeidinger, LauraSubramanya, AmarHsiao, SissieHassabis, DemisKavukcuoglu, KoraySadovsky, AdamLe, QuocStrohman, TrevorWu, YonghuiPetrov, SlavDean, JeffreyVinyals, Oriol
Source
Subject
Computer Science - Computation and Language
Computer Science - Artificial Intelligence
Computer Science - Computer Vision and Pattern Recognition
Language
Abstract
This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.