PaLM by Google AI

By

Recently there is a rumor thet Google AI's PaLM learns Bengali on its own. However its authenticity is not verified.

What is PaLM?

PaLM (Pathways Language Model) is a 540 billion parameter transformer-based large language model developed by Google AI. Researchers also trained smaller versions of PaLM, 8 and 62 billion parameter models, to test the effects of model scale.

PaLM is capable of a wide range of tasks, including commonsense reasoning, arithmetic reasoning, joke explanation, code generation, and translation. When combined with chain-of-thought prompting, PaLM achieved significantly better performance on datasets requiring reasoning of multiple steps, such as word problems and logic-based questions.

The model was first announced in April 2022 and remained private until March 2023, when Google launched an API for PaLM and several other technologies. The API will first be available to a limited number of developers who join a waitlist before being opened to the public.

Google and DeepMind developed a version of PaLM 540B called Med-PaLM that is fine-tuned on medical data and outperforms previous models on medical question answering benchmarks. Med-PaLM was the first to obtain a passing score on U.S. medical licensing questions, and in addition to answering both multiple choice and open-ended questions accurately, it also provides reasoning and is able to evaluate its own responses.

Google also extended PaLM using a vision transformer to create PaLM-E, a state-of-the-art vision-language model that can be used for robotic manipulation. The model can perform tasks in robotics competitively without the need for retraining or fine-tuning.

In May 2023, Google announced PaLM 2 at the annual Google I/O keynote. PaLM 2 is reported to be a 340 billion parameter model trained on 3.6 trillion tokens.

Wikipedia, GoogleAI

Comments

Post a Comment

Popular posts from this blog

Russian parliament passed a bill to revoke its ratification of the Comprehensive Test Ban Treaty

By
Relevance:  Russia revokes ratification of nuclear test ban treaty (CTBT) - ICAN But it affirmed that it will  retain its cooperation with the treaty’s verification system and implementing organisation.  Comprehensive Test Ban Treaty: The Comprehensive Test Ban Treaty (CTBT), which opened for signature in 1996, was intended to prohibit all nuclear weapon test explosions. Over 2,000 nuclear tests occurred between 1945 and 1996: the United States (1,000+), the Soviet Union (700+), France (200+), the United Kingdom and China (45 each). As at January 2013, 183 countries had signed the Treaty, of which 158 have also ratified it, including three of the nuclear weapon states (France, the Russian Federation and the United Kingdom). However, 44 specific nuclear technology holder countries must sign and ratify before the CTBT can enter into force. Of these, eight are still missing: China, Egypt, India , Iran, Israel, North Korea, Pakistan and the US. India , North Korea and Pakista...
Read more

Interstellar space and Interstellar Probes ( Voyager and New Horizons Missions )

By
Interstellar Space: Interstellar space is often called the space between the stars, but more specifically, it’s the region between our Sun’s heliosphere and the astrospheres of other stars. Our heliosphere is a vast bubble of plasma – a gas of charged particles – that spews out of the Sun. This outflow is known as the solar wind. The bubble surrounds the Sun and stretches beyond the planets. Both Voyager spacecraft had to travel more than 11 billion miles (17 billion kilometers) from the Sun in order to cross the edge of the heliosphere. This bubble is moving through interstellar space as the Sun orbits the center of the Milky Way galaxy. As our heliosphere plows through space, it creates a bow wave, like the wave formed by the bow of a ship. Kuiper Belt &  Oort Cloud: The Kuiper Belt is a doughnut-shaped ring of icy objects around the Sun, extending just beyond the orbit of Neptune from about 30 to 55 AU. Similar to the asteroid belt, the Kuiper Belt is a region of leftovers f...
Read more

ISRO developing semi-cryogenic engine working on LOX Kerosene propellant

By
ISRO is developing a 2000 kN thrust semi-cryogenic engine working on an LOX Kerosene propellant combination for enhancing the payload capability of LVM3 and for future launch vehicles. Liquid Propulsion Systems Centre (LPSC) is the lead centre for the development of semi-cryogenic propulsion systems with the support of other launch vehicle centres of ISRO. The assembly and testing of the propulsion modules were done at the ISRO propulsion complex (IPRC), Mahendragiri. As part of the engine development, a pre-burner ignition test article, which is a full complement of the engine power head system excluding the turbopumps is realized. The first ignition trial was conducted successfully on May 2, 2024, at semi cryo integrated engine test facility (SIET) at IPRC, Mahendragiri, which was dedicated to the nation recently by the honorable Prime Minister of India. Smooth and sustained ignition of the preburner is demonstrated which is vital for the starting of the semi-cryogenic engine. Semi-c...
Read more