New Neural Network with 500 Billion Parameters — Machine Learning Techniques

Google just published a research article about its Pathways Language Model (PaML), a neural network with 500 billion parameters. It is unclear to me how many layers and how many neurons (also called nodes) it can handle. A parameter in this context is a weight attached to a link between two connected neurons. So the […]

New Neural Network with 500 Billion Parameters — Machine Learning Techniques

Leave a Reply

%d bloggers like this: