Meta is hard and OpenAI, and the domestic "small model" official announces open source. Where is the "Hundred Models War" going?

  Since the beginning of this year, the global Internet giants have set off a "hundred-model war", and Microsoft, Google, Baidu and Ali have come to the end one after another. After more than half a year of competition, technology giants are welcoming a new round of road disputes around the big model ecology: facing the parameter "ceiling", will the future of the big model be closed or open?

  The open source model can run on a home computer.

  On August 3rd, two open source models, Qwen-7B and Qwen-7B-Chat, were put on the domestic AI developer community "ModelScope", which were Alibaba Cloud Tongyi Qianwen’s 7 billion parameter general model and dialogue model respectively. Both models were open source, free and commercially available.

  According to reports, Tongyi Qianwen Qwen-7B is a pedestal model that supports many languages such as Chinese and English, and it is trained on more than 2 trillion token (text unit) data sets, while Qwen-7B-Chat is a Chinese-English dialogue model based on the pedestal model, which has reached the cognitive level of human beings.In short, the former is like a "foundation" and the latter is a "house" on the foundation.

  The actual test shows that the comprehensive performance of Qwen-7B model is good. Among them, on the English proficiency evaluation benchmark MMLU, the score is generally higher than that of the mainstream models with the same parameter scale, even surpassing some models with 12 billion and 13 billion parameter scales. On the Chinese evaluation C-Eval verification set, the model also achieved the highest score of the same scale. Qwen-7B model is also among the best in evaluating GSM8K in mathematical problem solving ability and HumanEval in code ability.

  That is to say,In the tests of Chinese and English writing, solving mathematical problems and writing codes, Qwen-7B model is properly a "master of learning", and its score even exceeds the international mainstream model with the same parameter level.

  Besides, the industry is more concerned about the usability of Qwen-7B model. As we all know, the training and operation of mainstream large models need special AI training chips (such as NVIDIA A100), which are not only expensive, but also as high as 10,000 — per NVIDIA A100; 15,000 dollars, and it is monopolized by countries such as Europe and the United States, and it is almost impossible to buy it in China.The domestic Qwen-7B model supports the deployment of consumer graphics cards, which is equivalent to a high-performance home computer to run the model.

  Thanks to free commercialization and low threshold, the Qwen-7B model has been put on the shelves, which has attracted the attention of AI developers.In just one day, on the code hosting platform GitHub, the Qwen-7B model has been collected by more than a thousand developers, and most of the questioners are Chinese developers.As Alibaba Cloud said in the statement: "Compared with the lively AI open source ecology in the English-speaking world, the Chinese community lacks an excellent pedestal model. The addition of Tongyi Qianwen is expected to provide more choices for the open source community and promote the open source ecological construction of AI in China. "

  Open source or closed?

  In fact, Qwen-7B model is not the first big open source model. In fact, GPT-2, the predecessor of ChatGPT, is also completely open source. Its code and framework can be used for free on the Internet, and related papers can be consulted. However, after ChatGPT spread all over the world, OpenAI chose closed-source development, and the model codes such as GPT-3 and GPT-4 have become the trade secrets of OpenAI.

  The so-called open source is open source code.For example, once the big model is declared open source, anyone can publicly obtain the model source code, modify it or even redevelop it within the scope of copyright restrictions. To make a simple analogy,The source code is like the manuscript of a painting, and everyone can fill in the colors according to the manuscript to create their own artistic paintings.

  Closed source is just the opposite of open source.Only the source code owner (usually the software developer) has the power to modify the code, others can’t get the "manuscript" and can only buy the finished product from the software developer.

  The advantages and disadvantages of open source and closed source are very obvious. After open source, the big model will undoubtedly attract more developers, and the application of the big model will be more abundant, but the corresponding supervision and commercialization will become a difficult problem, which is prone to the embarrassing situation of "making wedding clothes for others".After all, open source considers ecological co-prosperity, and it is difficult to figure out the economic account of how much money can be earned at this stage, and these problems happen to be opportunities to close the source.

  Open source or closed source, this is a big model of life and death, the international giants have given the answer.

  Meta, the parent company of Facebook, released the big model Llama2 last month, which is open source and free for developers and business partners, while OpenAI firmly chose GPT-4 closed source development, which not only can maintain OpenAI’s leading position in the generative AI industry, but also can earn more revenue. According to the authoritative magazine Fast Company,OpenAI’s revenue in 2023 will reach 200 million US dollars, including providing API data interface services and subscription service fees for chat bots.

  Domestic big models have gradually begun to "go their separate ways".Alibaba Cloud’s General Meaning ModelAs early as April this year, it was announced to be open to enterprises, and the open source of Qwen-7B model will go further.ERNIE Bot of BaiduIt has also recently announced that it will gradually open the plug-in ecosystem to third-party developers to help developers build their own applications based on the Wenxin model.

  In contrast, Huawei does not take the usual path. When the Pangu Big Model 3.0 was released, Huawei Cloud publicly stated that,Pangu modelThe full stack technology is independently innovated by Huawei, and no open source technology is adopted. At the same time, Pangu Big Model will gather numerous industry big data (involving industry secrets, etc.), so Pangu Big Model will not be open source in the future.

  The big parameters are still small and beautiful.

  In addition, the open source of Qwen-7B model brings another thought:How many parameters do we need a big model?

  There is no denying that,The parameter scale of the large model is constantly expanding.Take the GPT model under OpenAI as an example. GPT-1 only contains 117 million parameters, and the parameters of GPT-3 have reached 175 billion, which has increased by more than 1000 times in a few years, while the parameters of GPT-4 have exceeded the trillion level.

  The same is true of large domestic models. Baidu Wenxin model has 260 billion parameters, Tencent mixed-element model has reached 100 billion parameters, Huawei Pangu model has been estimated to be close to GPT-3.5, and ali tong Yida model has officially announced 10 trillion parameters … …According to incomplete statistics, there are at least 79 large-scale models with over 1 billion parameters in China.

  Unfortunately, the larger the parameter, the stronger the capability of the large model. At the World Artificial Intelligence Conference, Wu Yunsheng, vice president of Tencent Cloud, has a very appropriate metaphor: "Just like athletes practicing physical strength, weightlifters need to lift 200 kilograms of barbells, and swimmers need to lift 100 kilograms. Different types of athletes don’t need everyone to practice 200 kilograms of barbells."

  As we all know,The higher the parameters of the large model, the more resources and costs are consumed.However, it is not necessary to blindly pursue "large scale" or "high parameters" to deepen the vertical large-scale model of the industry, but to formulate relevant model parameters according to customer needs. For example, the BioGPT-Large model has only 1.5 billion parameters, but its accuracy in biomedical professional tests is better than that of the general model with 100 billion parameters.

  Sam Altman, co-founder of OpenAI, also publicly stated that OpenAI is approaching the limit of LLM (Large Language Model) scale. The larger the scale, the better the model is, and the parameter scale is no longer an important indicator to measure the quality of the model.

  Wu Di, the head of intelligent algorithm in Volcano Engine, has a similar view. In the long run, reducing costs will become an important factor in the application of large models. "A well-tuned small and medium-sized model may perform as well as a general large model in a specific job, and the cost may be only one tenth of the original."

  At present, almost all domestic science and technology manufacturers have got tickets for big models, but the real road choice has just begun.

[Video] The Lantern Festival party will debut tonight. Watch it first.

";
var guanggao2 = "";
if((video_ad_channel_id=="CN02"||video_ad_channel_id=="CN05")&&panduan1! ="C24757"&&panduan1! ="C20695"&&panduan1! ="C20694"&&panduan1! ="C10598"&&panduan1! ="C10473"&&panduan2! ="C15661000001"&&panduan2! ="C15661000003"&&panduan2! ="C15661000002"&&panduan2! ="C15661000004")
{
document.write(guanggao1);
}
if(panduan1=="C20695"||panduan1=="C20694"||panduan1=="C10598"||panduan1=="C10473"||panduan2=="C15661000001"||panduan2=="C15661000003"||panduan2=="C15661000002"||panduan2=="C15661000004")
{
document.write(guanggao2);
}

"The news knew" that the latest judgment on the weather on New Year’s Eve came; Summary of opening hours of Hangzhou stadiums during the Spring Festival; A number of courier companies announced that t

Today is Saturday, February 3rd, 2024.
[Weather] Light rain, 4 ~ 6℃
[Restricted] None
[Air quality] Urban AQI:36, air quality grade: excellent.
local
hot spot
(1) fall back to below zero! Hang in there for a few more days! The latest judgment on the weather on New Year’s Eve is coming!
Hang in there, the sunshine will return soon!
② Four docks, such as Wulinmen Wharf, can go up and down for free with the bracelet!
In addition to the special dragon boat, there are also interesting activities such as Dragon Drum Opening Year and Long Lin Sign-in at Wulinmen and Native Products Wharf, with three different seals, which can be exchanged for unique Chinese New Year gifts after completing the stamp collection and punching.
(3) Eighteen literary and art workers in Zhejiang Province were commended.
The Second Commendation Meeting of Young and Middle-aged Writers and Artists in Zhejiang Province was held in Hangzhou.
What are the opening hours of Hangzhou stadiums during the Spring Festival?
Do you have any plans for exercise and fitness during the Chinese New Year?
domestic
international
Spring Festival travel rush return train tickets are being robbed! Pay attention to this information when traveling.
Is it good to buy tickets for Spring Festival travel rush this year? What’s the change in the weather? What preparations should be made for travel?
From March 1st, you may earn more money!
The 2023 annual settlement processing time is from March 1 to June 30, 2024.
Gao Weidong, the former chairman of Maotai, was sentenced to life imprisonment for accepting bribes of more than 110 million yuan.
The illegal receipt of property directly or through relevant personnel amounted to more than 110 million yuan, of which 46.56 million yuan was not actually obtained.
(4) A number of courier companies announced that "the Spring Festival will not be closed in 2024"
Post, SF Express, Yunda, Debon, JD.COM and many other courier companies have announced the service policy of "No Closing during the Spring Festival".
Reporting/feedback

Breaking into Schumacher’s garage, Ferrari’s dream begins with F50 (Figure)

  Backed by the Alps and facing Lake Geneva, the home of michael schumacher, the seven-time F1 world champion, is located in the Swiss mountains and green waters. Under the aerial view of the helicopter, the "ancient pagoda" of "Shumi Castle" is conspicuous, which is the "indoor climbing ground" of Schumacher’s family. In addition, people can vaguely guess that the big house is Shumi’s indoor swimming pool with Schumacher’s championship trophy hidden in that small window. But Schumacher’s favorite thing is hidden under the "Shumi Castle", which is Schumacher’s parking garage with two floors, enough to park 19 luxury cars.


  As a former driver and current consultant of Ferrari, Schumacher always drives only cars from Ferrari and its parent company Fiat Group in public. Although there are many Mercedes-Benz and BMW with pure German descent in Schumacher’s private garage, it is a pity that "professional" Schumacher never reveals only those stories about him and Ferrari …


  


  


  fiat 500


  Dedicated to Fiat 500 for the first time.


  Up to now, recalling the story about Fiat 500, Schumacher will smile sweetly, because it was the first time Schumacher drove a car in his life. Can you imagine such a picture? Little Schumacher sat in the driver’s seat of Fiat 500, his ass barely touched the seat, and his hands and feet just reached the steering wheel and brake pedal, so he rushed out with excitement. As a result, before driving far, the car directly hit the lamppost, and little Schumacher was almost bruised.


  Perhaps, Schumacher’s love affair with racing car and Ferrari was doomed at that time. Up to now, the Schumacher Museum in Coppen, Germany still houses the first car of Che Wang. Of course, it was not the one that Schumacher crashed when he was a child. After Schumacher came to Ferrari, Fiat President Montezemolo specially sent a brand-new red Fiat 500 to Schumacher for collection. With round headlights and a small and lovely predecessor, Fiat 500 is like Italian chocolate, which will always be an Italian classic and hidden in the sweetest place of Schumacher’s childhood.


  Love at first sight for "Super Bugatti"


  Now there is no such car in Schumacher’s garage, but it must be mentioned that the Bugatti supercar is actually Schumacher’s first private car. In 1995, Schumacher was the driver of Benetton. In that summer, he took his wife Corinna to Campogalliano, a small town in Modena, Italy, to visit the factory of Bugatti, a top super-running brand. The boss of Bugatti, Romano Attioli, decided to give Schumacher the latest work EB110 SS.


  It was a yellow EB110SS. When Schumacher took the car keys from Attioli, he was still very dissatisfied with this car. Unique design and color matching is Bugatti’s consistent style. Schumacher got the EB110SS with a blue leather seat configuration, and the center console is also uniform blue. However, Schumacher raised some questions about the design of EB110SS hollow platform, and Attioli’s answer was that it was the most fashionable at that time.


  Car king’s affection for Bugatti didn’t change until after driving. The 3499ml V12 engine has five valves per cylinder. With the help of four superchargers, it can output the maximum power of 611 horsepower (which was quite advanced at that time), accelerate for 3.2 seconds from 0 to 60 miles (about 96.5km) and have a top speed of 350km/h. All these indicators finally make Schumacher’s face smile. Unfortunately, this Mohamme Bourkadi has only been in Schumacher’s hands for less than a year. After joining Ferrari, Schumacher quickly found a reason to ask this car out of his garage.


  Spyder will always be like a lady


  In October 2003, Schumacher bought a new toy in Italy-the blue Masalati Spyder. Like Enzo, before getting this new car, Schumacher gave a rigorous test to Maserati Spyder at Maranello. The car king, who has always been plain-spoken, used gorgeous words to describe this car: "This is a great sports car, with outstanding design and cutting-edge fashion. The engine provides endless power. Maserati Spyder is like a lady who can surprise you at any time …"


  Like other cars, the biggest feature of Schumacher’s car is that it is fast enough. It takes only 5 seconds for the Spyder with 390 horsepower to accelerate from 0 to 100 kilometers per hour. In addition, the biggest feature of this car is that it has no clutch and no shift lever. When you want to hang the AUTOmatic gear, just press the "auto" button at the lower part of the center console. If you choose to change gears manually, you don’t have to leave the steering wheel, and you can shift gears with your fingers, which is very similar to Schumacher’s F1 car.


  Luxury gift FXX has only 20 cars in the world.


  This is a gift from Ferrari to the car king after Schumacher retired. On Ferrari Racing Day in 2006, Fiat President handed the Ferrari FXX to Schumacher in front of more than 30,000 fans.


  Ferrari FXX was built in the factory of Maranello, the base of Ferrari racing department, on the basis of Enzo sports car. Its engine displacement has been expanded to 6,262 ml, and its maximum power and peak torque have reached an astonishing 800 HP and 690 N/m respectively, which is also a super GT sports car closest to F1 racing car so far.


  Schumacher’s FXX is painted in all black, and the car king undoubtedly likes this car very much. During his stay in France this year, Schumacher attended a charity event. He took Zidane, a famous French football player, for a wild ride on the Magney circuit, and the car he chose was his own Ferrari FXX.


  This Ferrari’s top sports car is limited to only about 20 cars in the world. FXX customers will join Ferrari as its test drivers and drive the car under the supervision of Ferrari experts. Ferrari regards FXX as the basic framework of the top-class models to be produced in the future, but FXX is neither a legal streetcar nor a racing car, and it will only become the car of the first customer test drivers on the track in history.


  Ferrari’s dream begins with F50.


  In 1996, Schumacher joined the Ferrari team. Since then, King Che’s garage has almost only added the brand of Fiat Group, and the F50 is just the beginning of Schumacher’s dream of Ferrari.


  The 27-year-old Schumacher is sharp-edged and unruly. When he first appeared in front of the Italians in a black suit embroidered with Ferrari’s prancing logo, the German looked arrogant. Ferrari’s performance at that time was not good, and they needed a car to dispel Schumacher’s suspicious eyes. The F355 is not fashionable enough, and the 456GT is not sporty enough. In the end, Schumacher took a fancy to the fiery red F50. The F50 is an early model launched by Ferrari to celebrate its 50th anniversary. It was designed by local designer Pininfarina. It uses a 4.7-liter naturally aspirated V12 engine with a maximum power of 513 horsepower, and a 6-speed manual gearbox with a rear drive in the middle, which can achieve a performance of 3.7 seconds for 100 kilometers and a top speed of 360 kilometers per hour. The style is divided into convertible and hardtop, and Schumacher chose convertible at that time.


  Since Schumacher joined Ferrari, almost every new Ferrari car has been "personally tested" by Schumacher before it came out. In addition to being a driver of Ferrari, Schumacher has gradually become the image ambassador of Fiat Group. At all kinds of large-scale international auto shows, Schumacher often appears next to Fiat’s brands, whether Ferrari or Maserati. Schumacher also often shoots various car advertisements for Ferrari. Of course, no matter which new car Schumacher likes, he can drive it straight home at any time.


  ENZO belongs to Schumacher’s "Red Rabbit"


  In 2002, Ferrari launched Enzo, a model to commemorate Ferrari founder Enzo Ferrari, and Schumacher, as the soul of Ferrari, naturally ranked among the first customers of this car. For Che Wang, ENZO is definitely a "red rabbit horse".


  Enzo uses a 5998ml V12 engine with a maximum output of 660 horsepower. It takes only 3.6 seconds to accelerate from 0 to 60 miles. The biggest breakthrough it brings is to learn from the aerodynamic design of F1 racing cars. The body design puts functionality in the first place. Although it has been criticized in aesthetics, it is definitely the super sports car with the best performance in its generation. In order to show Enzo’s king position in civil super-running, Ferrari also put it together with F2002 for Schumacher to test drive. Of course, Schumacher came to an ideal conclusion: "Enzo’s high-speed state is very stable, and the turn is neutral and very powerful. It is the most powerful road model."


  The fastest track, the safest road.


  Schumacher used to be the fastest man on F1 track, but in real life, Schumacher is a good citizen who abides by traffic rules. As the image ambassador of UNESCO and the FIA’s road safety ambassador, Schumacher has always been active in promoting driving safety.


  In 2005, the United Nations held the first "Safe Driving Week" with the theme of "Young People on the Road". As the father of two children, Schumacher looked a little uneasy after the event. "I didn’t know that every day, thousands of children around the world died in car accidents." Schumacher said, "As a father, I can understand the grief of parents when they lose their children. Just this morning, I read a news that a father took his daughter out for a walk and her daughter died in a car accident. Now I can live happily with my children-and if there were not so many car accidents, there would be more happy families in the world like me. "


  Schumacher’s driving record never recorded speeding. The only exception was that Schumacher himself took the initiative to admit his mistake. "An interesting thing happened before the race in the United States in 2002. I drove to Indianapolis on the highway. Maybe time was a little urgent and I seemed to drive faster. Then I suddenly found a police car behind me. I think it’s too bad, because I heard that it’s hard to find an excuse to meet a traffic policeman in America. He stopped my car and said very seriously,’ Do you think you are Mansel? Even if it is, you will be fined. I said,’ OK, but I’m michael schumacher.’ "Schumacher said.


  According to the reporter’s interview with the policeman afterwards, Schumacher actually didn’t tell the whole story because the policeman didn’t know him, and then said, "Sorry, I don’t know who Schumacher is." Schumacher’s response was even better: "Then, I don’t understand what speeding is."


  Send children to school without driving a luxury car.


  Schumacher will drive his youngest son Mick to see his favorite idol, Barak, and will drive a Ferrari to accompany Corinna to travel, but in daily life, Schumacher insists on driving the most humble Lancia. The reason is simple. Schumacher wants to live like an ordinary person, and he wants his children to grow up like ordinary children.


  At home, Schumacher is a good father. He will personally take his two children to and from school, play their favorite songs on the way and even sing with them. When the whole family goes out, Schumacher is the obligatory driver: "I am a loyal and relaxed driver, and we will laugh and laugh all the way like ordinary families." On long trips, Gina and Mick are very cooperative passengers, and they usually fall asleep in a short time. " However, at Schumacher’s house, Corinna is also willing to be her husband’s driver. "I absolutely believe in her driving skills," Schumacher said.

Editor: Shuo Yang