From c3ef20e196c467010b98bcf272ba77c2fde06ed9 Mon Sep 17 00:00:00 2001
From: ModelHub XC
+ Amid the swift progress of large language models (LLMs) and their evolution into large multimodal models (LMMs), significant strides have been made in high-resource languages such as English and Chinese. While Arabic LLMs have seen notable progress, Arabic LMMs remain largely unexplored, often narrowly focusing on a few specific aspects of the language and visual understanding. To bridge this gap, we introduce AIN - the Arabic Inclusive Multimodal Model- designed to excel across diverse domains.
+ AIN is an English-Arabic bilingual LMM designed to excel in English and Arabic, leveraging carefully constructed 3.6 million high-quality Arabic-English multimodal data samples. AIN demonstrates state-of-the-art Arabic performance, while also possessing strong English-language visual capabilities.
+
+
+ AIN: The Arabic INclusive Large Multimodal Model
+
+ *Equal Contribution
+
+#### **Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI), UAE**
+[](https://arxiv.org/abs/2502.00094)
+[](https://mbzuai-oryx.github.io/AIN/)
+[](https://github.com/mbzuai-oryx/AIN)
+[](https://github.com/mbzuai-oryx/AIN/issues)
+[](https://github.com/mbzuai-oryx/AIN/stargazers)
+[](https://github.com/mbzuai-oryx/AIN/blob/main/LICENSE)
+
+---
+
+
+Abstract
+
+
+ Figure 1. Comparative performance of AIN-7B against other models across key domains, including OCR & Document Understanding, Remote Sensing, Agricultural Understanding, and overall performance across all domains.
+
+
+
+
| Models | +VQA | +OCR | +Video | +RS | +CDT | +Agro. | +Cult. | +Med. | +Total | +
|---|---|---|---|---|---|---|---|---|---|
| GPT-4o | +🥈55.15 | +🥈54.98 | +🥇69.65 | +🥈27.36 | +🥈62.35 | +🥈80.75 | +🥇80.86 | +🥇49.91 | +🥈60.13 | +
| GPT-4o-mini | +48.83 | +39.38 | +🥈66.28 | +16.93 | +56.37 | +78.80 | +65.92 | +🥈47.37 | +52.49 | +
| Gemini-1.5-Pro | +46.68 | +28.68 | +42.95 | +17.07 | +47.06 | +72.14 | +56.24 | +33.78 | +52.38 | +
| Gemini-1.5-flash | +45.59 | +27.58 | +53.31 | +14.95 | +48.26 | +76.07 | +46.54 | +42.87 | +44.40 | +
| InternVL-8B | +30.41 | +15.91 | +51.42 | +5.36 | +30.27 | +44.47 | +20.88 | +29.48 | +28.52 | +
| InternVL2.5-1B | +27.22 | +19.45 | +38.20 | +3.39 | +30.75 | +39.53 | +35.68 | +21.27 | +26.94 | +
| Qwen-VL-2B | +41.02 | +22.93 | +38.90 | +12.56 | +27.83 | +52.02 | +34.28 | +29.12 | +32.33 | +
| Qwen2-VL-7B | +48.76 | +42.73 | +61.97 | +21.30 | +54.67 | +79.32 | +75.96 | +35.81 | +52.57 | +
| AIN-7B (ours) | +🥇56.78 | +🥇72.35 | +64.09 | +🥇45.92 | +🥇64.10 | +🥇85.05 | +🥈78.09 | +43.77 | +🏆63.77 | +
+
+
+
+
+
^MDIN<>UnN{JKXt}4ed!Qnzc1M~WMLyd#aIxeeS&~(h+<=nfm^^4~?f1wCJwP>(8 z*}`lie_1gp9f&gia=`Kv&4hLFE2%3dkP2TEqo70CVi+h;WeELh_U_N;Q{Yu@#rq@v zr6_nndyoQ|Zfd|R0dRaSg1|T8DJDOd_n8mHZS?OXpn()T#H+NmwLwjt&u0J*PZz)T z{$Gwt?K(OV>73j=J0Ax;uK_cbpC@8;>vI$s8s`QAdm=j`(s3w?-}G3!nKZZ=05HT& zY&T_~*&zagsinW+x_Q>%?zLpicz-1OjPti-D6mHWRQ=xxW==ccb8m~Nbz&E$u<0%e z4N;liKW4+FZq4TJwz67%LsoopVh$G(l*#K?I zFbWnXrB&Xy_QZ&m3FaSVu)Y^~n5`w4YV)YGRi$KP;jIQwmxuN_gRop2dGq4g0B#Mj zo{MVLl) ;`@_N$MabLx zKz;S$v +NC3+n9$66Mdn+%$MwGl#zozL$f zm{b2Vbo}+u2f%&)|1k8MMtzx%G$hE;phzrn$xB5I{7I!W04&jwD%i0;-dx$&($|25 zQ(5>Xl90wIC6Fh`%pPozJ>&K%2w9CHkKg|KD#esU=e))&I72jOyNv2`<}9iC_)%1h z)S-}Niqop)!S;&ePggrMoR*(UMfWq(R}AzbFU!7W7BYFfdnK`6#c!uNvizJ(@i6(I z=7kal0h@|itxmHmwk{=4LVmDF+KI}#*l 88G zYx-KrD~%&_&h;wrX^C|=lP33B;xtQdvF4J|erXof_p=uRRJI{K^ca*~C-)a^9_7TC zQ$&t$q| 9wSuPdW{jA*`K7ZwFJg=zUeY+a;n`aF+7ZWDldf1`;K_?y45N zJtUcW4zG=>*gE!^tA)4!$W?QwbU%(e#Xh54To5b9Rk-5ZYoR&DzpJ!vAzVI}r*C7~ zC4ZWMZ%8XLj<>qY;zBv>_K5a8;IFI;2OY|ebTi0{he_8&L^Rd~ylt#&1ioxsPW{d2 zx7E6`E8K0g5UzKr9N$o% AXblQ8d$61pMKqmxj zs$4B2Ed;*u=GILY+<*YK)ewPK{{~(I2q90}zp*aK1O;{r73sK|DTZ|yKpiHIMp}=N{KnlwZaEJhY+;U`pzN&+Glm2-8 @Lc2YMNoo zqcG-5Ap_?608g0(w!rQA*)jBjn-=1xc *chcpM zlAdx-w3+#AK}SX;3m&W<_;xZGj2Vh>DTj5UQXz+#!?(SLOP44lb fPWqIu(r z&sB~04tBUXS=nZ%*Qx0Y-nofQc2EJ@Yw%NiiGE}C`+>fBF9?RB1N$jnCn?bJGYXNP zH=wP4xO6}Dt6M_mBo#0raSsa@u9^59L_atZieF7};&p%rxs7!I{Y^vkvH{ym?TPx6 z`d{;z&$v$PJ}Jx_JO@bmc5_;LkD80&*nlHZoE8eKSw78;LojuolW5g<0b|)?F*;4W zsSaTg16HjH0L%)&)KO4jVeEfn%MQu)EZ#hSiFI=p0A6`F1%W95^Ow1X%|j*wPr_~8 z8F|De0e0EUU#ZZc_62Y~A!mPyzH4)Dfxe5nA$;eCy1#C;zRm>6%p*S1{)fW49>5?F zz`0xW08j(ia%;i=t{TMNdf7oxu}4)91s0r`zeeQ&Zu@fw#Z{jHi0(L#0SktaCEsva zZuHm5;SV`ptUqhD D2Xh ze_FMe2X^q|O^C%NbvCYM%gm`*31yIzNfM52O)>>c+)i07lL{%E3BCZKh>0o@Nu3r& zC5}+iM~h0rQCKf3Xn1E8#FaC2(qkU^ME7N8m6D#=>PC8}y57!{(UQRDlnW*eVh~2! zU)-$6kJpTca7rb_BGNenbb>OL#*T c|B6z~Hxh|5GjaxKkkG%WR17-G! zs7;>9vs}E<3+5(HXAe`B70jL-c+#Y2vGXYFvGsd)K34NR$>~b zD32CPPk!3tY+_L@JR8YY93Lk|6FlX^3mR`J7oD1nTB$F$V>md4z14<}^x#n)hIdDj zrn$(cdlMS$rZOG8uJR^Tx2G!?A!pwrB&h7!?Zm6LAO~=m+q-jx25ngLHcR$!&iX!# z6A#N5%aIQ%=#aS!JJL51!!a;ll1BblDG`vUL%_Z&AgNW{&?2cf(lt#{0H4qSeDbtL zZk3ReDADd|vjAtPR*g@&ETMr$aj*OF$35T=UpI&M?q~Qu{6rXERr9GnDFEIwU}AVC z63~jeO8_*5<7;S{LbgFh5-AES)a16YAYc*#8tV*r(V@L{0jU3C=EhAxKwX@zy~F<# zUHtmrN#}~vLdF?E(ojP*#mJk6{_W#wkDZkg(m{R_90<~VSLM~Vx5&d&kON2>wFBoI z*8(6C3eZzTzZ!p_gl~}5Amb~IYJYSN!LLFEkZ`vBTp9l=r~P|rHVQh(xTXC3EXVPy zkRE1#JuAtQq^TH$y3N%~JinUH^YmS8XsPq{U9|e4K*47f4=zg*N55{JmIGvj2y#`B zw2W_tklq+b=z1U(HLidg1I7JkZP)Jlc~;C$gDFYRb2@{>bcU>`#XLWnF{+ggqE+oD zTTO&tIo@V*oM)_+QI21!<*{#Tkl%8O0#f85V6@u_7&rMF`v9 !h3T(k??PMbcpVc4#ul6RI-}swPP_sgR^tuGEd}t!2LH zc0pY?mLil_7n|_Dm3NQQCU7#D`(*KOtA#CmGrzpV%=~z7WJ4gFL@)ri{DpeOh#>)g z?B_{=_E!?`L$jXb2RxN!k@zTTJghgp$LXSowtr<2W?FwV^D=s{jkm5;MtD $7K>4UFtPCR){`;U!Pab`G_yC>CAD`&`J1IaXuX^v6kTg4n)( z3F1y2TYB_Sb^ngfIE(YqRnU^doL*$dLc7iI{C0MStD%4o_$RoPxqC@oGUK&UzMk7) zeXd%u{qbl>xXN~DbM0Vu5!OsW70eAQftvJ77G!6PLp(RVb@2ZVD*nK^8R9YJ+=w)1 z7;^ZeAf3E3Ndr0N%AeeyG)@fVsIQRPl(GXUa5nQ>7FMRbuv!yIUHoq-G!WMpp2cAh z`T2Uh5qQ%|Pm2QA9rK(XU=;%|X&_pnfJe_G=(~ZEYUM$gDR3D3diRe-*CHZ4X?-wn zU?vEdLZ6{;3iGp&oI7bF-7lvXT?;m{a>CdEbr;SISQSO3K;}xeq!Yf7@!LG7fiD4= zNe9CKRJlOcbR%is`Gx@k&Bl6$+aJx|@%YcoJ`DUo^@A&hQTlndWNsvW8)@U3EI*ma zt+w1)1Q-oLc0PZTi31-6*2Q$GyjXT$S(5fHlIt6g`T$BNI1J@RR@9iw1Sa||J8JPy z&}r;o=2qD{HcAL>- Wp*w_V6dl`S(`X>8N5dB*)_ zyM?OF9EZFg=2~yvkRTQ^6x_IaCvZc?N`=}lMJlj7-1$mP(#lP8Wv;O5c#b+Lv{>qS z)Y7qIP15MM9E~3~d^1eSM#`psvoZzqc_=1&EOeoY3mH9m#ZNtppMN4Z&Rbo5JnUj_ z)b?p@Se>kzoObqGQ23ix3pU4 zn|8dLYfqjwbjMDoVIjr0;do)>?0x0_&$11B?ChPHsimKDYCc$V-6?nCeNJx{tNapZ zzy=Tyb^hx?Bu#*Rx$NOr9+UcgB^!cz!lG1c95^(WKL|`A9Y5c6D0rO7s~V2E)QO}I z85vUF>dbOTr?eK33Jz_weMcqOdTObq%B2Auzo? 8(@$3>R zqiWY%80l}hUtjx5q!(r+E()7{3bGHWf800RQNr=29u8jDnD`HzvHrNYSyYgah(@79 z;fL(EWBHF$;U i?FQV{8vKb%Sho~z6z7P)wRc-ZQ228 zUCM&F=|oB4QPXbza0hu@&!4w(XJy)yy7}d*bDUE54~Mfhb?2OvwbGjIp*PQXmuCX9 zR2*q_YlQ2t3zR}EQ|B);<0&rwge*k#^ZURN_|gtIBmXNV>$R9AKuluJZ$bYNbMU5^ zk5(G)khaI(s-FLvnK>1!vUFc;%*qFc*l(If!shM%aDK8u7BJ5zYn$0ALG_0c9nN~M z1~L3 qU$<3Jc0ZR-Dr0B0EvHj_frhPA3x!x3Z&e$ z0R)6r9gFgRwpPfQL(p1_q_STp%CoIVGb`D&@V!_#Gp2LX6Q!_Iu|@uVXk^*PG}$d; z6Ko$=zRB-F>NdQRcAx~*aaZD3I-9r~8Zj5gFy4ArpL^f9T2j8fcR!E5H!3p 8yLNQq1+ zP%9?aCglZkWE07t%tz*woEhv=oL9}NKJNmJvz}YlEq{nw^svw;@x|CA`j)?J&-&Az zrD=9bAphX2tnz)wp0qA+K?;?uXT6&vDw^<^2Uc%QaH^aoEFO$cDIW0qiG4rSt{pKr z!^*PGEIo>B?BQ>+)VTVhSy?8|l{P-fvpf|S{3;G_O^4po$-0P^GqJQHO*l2#&OW7C z;^;KYG0j~9cIV6IZ_!4y5gh|E!8sX0&eVz@#MCnjPxXaIB+E>cDb)2l1+i@}@13W& z-mxL8Ai9E;QwB&<8uZQjOr8-9!wbl!d$k%Y0X958bG7rlDw|fd#U5TyIi)}?Sa93Z zTdAPAyb(C0=hr}@aN!iq_%CVcW_qm=fuKZ$DfE_0@x|Ne@y{f3_(BY^+*)r7^fY*` zi03+bL{k&RM)Dmpsa<5}eZqY_B|}rqPwDTVz%WZSOKK+4yuPp 1wN4Xap#3775#EWdX;;Rjd@WkgGgidI9WLjrWgiv4|KP%QUeugy8 z+@Gqzt7OBji~jjW*z?wK>henE^e%yV ZL+SZhw}V2~`u^nGprXZ(bX>mZc9U#i z1M4x@rOb=-Z`dOQkx=V3D8t>qrT}Rm+ji`96ih~s^sFHKuss72x%qme)sJ`mYGMWt zN!|~>=z3a1Ilbd-TS|ovC6A)gY&-s-0r(4l05UZxZW03aZvcGL{h-+Xuk-bx19QH8 zJ?Dq$pq>KghlmG(Eey&bO4yO@`m=1opqA38$43v*;;o+b=Ot7AV0FF3pkj^e=eac4 z^6f;@i50Lp1L)A{&?VwOmM=Y@2fTp~8(*jJAE?qOfv6?YzFu%_-reMWUJuyULG}`( zciS~7;>S fWu6<)V@7^rMXX~PZ}mkdlf z{Lx+fMtUD3Xt3fuyVKK|t3uhx2g)|`iEeOlh}iN`>-#Su?|rTI6%uCk_Gp`ISGi|< z88k?4!Jf8|H2A6@Po!~mbShYVr5&6w3*$5 u3~_K{d`POsoZ# zahSF^%1pMJ23fa$6);~7oGQqrv-4#ZNO5ORavu?qc!$e9nlmR1YQb|1Q&Xf+)`AJy z-d$_S5$NIAazJmGW|+nra9sD4BkO-@Jvk&N>oF%4JU1p^l%lpRK37xF^XmKzAjn$J zxry0}jp;0XvI@h?l*vfL%ZN#wj`GNbpA8*ucqD(63HaxOYi@Wckn~Ry v2&j9hkMAYvV>@Z@wR;O5EGx|CFUQa%kNkRDj||kj`aXW;aAqj>4UHha zuJX6VDy;u8LmF^~Q;!K$@#4`y{*>Dq_|57l?epiK!|npo$>QA`V+#o=AMcPv*!B-T z2uFu V5c4t^J_B9urDVW4Qs_GCX#BR~}=JbNKJ0d-cVq)yM&Y;>% zvj>P*x9@#=;vwE-D+j~Y@3ub@>@n(`W1gY>XQ@EN(G^nx2fy+by2?#CegX8c{Q`pi zC#p-DBC)C`=w!>DP;Ktx3SxO%*`w1X Ebu1Fq{?V a%w@#)L3^!!@_rGw C~q%SP(t-zuV;Z2*EEY?qBF*fB~Fnw;V0R zQ2SRD*jWBz#}cQ Y9)p9S O%yHCN>;Y#7omKR$TaNtk*-95wZem0dUlFxU!O6U)<~!f`t|ga9gw6vm*% Dz&^Rl9peqVr^cp`lrrxyV4 z-XS>NyAW{t1$U6bznTxrRpl4=X|R13Pc?@GeWFeM!W <5X=!4*3_Mp?Lyhl>@ z`xTRV9UIT)8YLY=@{%(3U$5-ERZK=)K8l9>EAu}Ju2adK!QvS{m(nzgG9fC!6Eu8E zo6vfy+>gWa0VSyal9H)^mH7Sn-t)=y21W09m_$ uJ@3RRv1aZ=|GBRiQO9%s3h9$K%R$;R^CTFqSTc~eUx ze|dJSQEkCzl!!&C(~qbOBqYnkIDCrYsgJKpzc|trDf%2Mrn O()xaC&*m;%fU^6`2J^$OQpAZ4N z7=JD^KU>iE3R%SVGr%+kPcTE;CFYnZav#4V%6o_7=b4m7^8+QQx_z3B2Ejn(b6ujD zHq@9i2>|TLF&|DY*m8W>@hhT)m-kC i&R( zf$Z2T4Pt{7f7h57G|l+Lgl=NFL{w-=%hle&uPi7j;#;VG3?tzq_gJHA`$hvDHtgN+ zF~F}};wLgOn==SA3TZu6^U)IXSq|)Vws!=r03?2%3jmP+c++nAuRM3Jvo =z4?*jyBn6MS^OTYxMZNb+!a!aY(gps-z<~aPa$^Zux?clGF2Nx>G9C6u+H*rW) zSp$P%d_Svj;1h3`vQ_g$CG9-_)%g#M?ztoifK>rqBn;YL9Mc`h{$K(xRA5q40g7gC zfBPyg9dKsT3k1P&)0&mEK+rDK#b!l2Sh)rdG#M`G#fznd*zd08Bh^vO$>Z;zt_h{1ZioZU~KaA9Q1?XNC5^9U(hY8_=DJ2M{YEx z>GS7f@xFM|{O;Jp`nu+dyjXc#u)YqVNZ-B7AW%AZ32lMkNN%lqLbR1d?TG6_hw&=b zO|8Af-*C2?A0^`SJxvP?n|b3N;lo>@*i(Laf2Gs8hqBrl_l%#a-}!+ye#d(yYjnxy zrP0vLdqwUNfx o8_^sSlQ+T z$-w*=6XHx!$#;w&{wguIrqsBMoR+CJAS@`aV9O&JT^uP(mECH3nUW=f#rTC*hqJ2e z^psh9i0p&Mw*8P=*C^u_v%?cdL)+V}{G^>`r`5^%%4!NW#(b&6pDVhmu|8f^jhkti zOLeYW3~HPQ+$MiwnEXAM@h3wADdR6AoVbN|8_E}Ln+olOu$JK1D;#&p^R{;H$_srH z@@%f8SC$|(?GdcCzEEwrV&1R1=#@&`s=>V!n-OX_Q(1BqKdTkQ;s0&B*Oeh`5M#CY zo)P_S9c#1(p+(=^66h*Tv%E7@jf5D)wz?_g2D|9T#x*ESkXUy+U&go%4A%SXlIm;f z{-{|m!!phvIxNP>iAVFrzvTzjR$?=v6rxf!dE;+SinelAryqV42*I&tOJw-^9dCPp z!%3U}Q8g7cM%9=yJzz}bH@gm;* CirQg$`z&6jTAKW*ZV?+;18gYWN Em?L}EUEsey-C=e__~Wi7k;=f*l$bG;JY0sC%7b%5?uoayH&4-^G@ zLKfZp({fgF-V&Mn)FaHqY=R0QF_RiZ3r}J*ucKqkLa^0kYM;ULVS;0(no!|m6g%0y zrvb%k$8FiG=kDjAN|FyEb$?0ikKelm%IiC^z|UR13}pBX4iJz?uLT2Lp4CipFZI7y z*EHPG1)B&LZD2t!fc1tI0$%y&36e7=(y@HlHt36*5*vBMOeW;0wiEr%y0=mlxWR=k zUqbrhHlk!<01)Dc0HR?FVg{K M9vobZPo^8pk02PNHlUzU~5P?%2!aA zU@o#l1C+SeKuXm?I}vG|H1+Wjl>b88V9IyNaQX;JrVyec>FQftxv(Q^o%AK^^cT(d zM~#pj1q$X#JGH5YXAg}rbT d5u4HKKIQ7A6m}S99 BEz4^I82MR-d8o$RYCP z1;^yaEbCCw@Tdk1$t&*(cy7SP>0Pv0l#RrsSX_au$6CMg54$(h51&`7ggy2lRpyi! zpTV=*CR|(V;(xWnJUL9J=z`sG z`yL3B#@p>UY9!0LIw>W}xq8$yekW%e#d25d)67NotD(EDR|j!LpUTy=1N4}Hk97S1 zjy3&+q!IjTR6);tb>ek%;DuUq$ZeY5M*?>qyafj1auJvC+S;|8N I3xI=R%%V*2X|DY|NnxfZphbRlz|RX5C$rMh#;2FK>fQwLpHIhI*zA} z%vYir3;lp;itjV)9g-E<+q!uuF7`eLucKHD@!Leah~|Fn=