Saturday, January 16, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Data Science

GPT3 and AGI: Beyond the dichotomy – part two

September 26, 2020
in Data Science
GPT3 and AGI: Beyond the dichotomy – part two
586
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

This blog continues from GPT3 and AGI: Beyond the dichotomy – part one

You might also like

How Artificial Intelligence Can Benefit Education

All about Use Of Data Science

20 Of The Most Important Machine Learning Interview Questions and Answers

GPT3 and AGI

Let’s first clarify what AGI should look like

Consider the movie ‘Terminator’

When the Arnold Schwarzenegger character comes to earth – he is fully functional. To do so, he must be aware of the context. In other words, AGI should be able to operate in any context

Such an entity does not exist

And nor is GPT3 such an entity

But GPT3 however has the capacity to respond ‘AGI-like’ to an expanded set of contexts much more than traditional AI systems.

GPT 3 has got many things going for it

  • Unsupervised learning is the future
  • Linguistic capabilities distinguish humans
  • But Language is much more than encoding information. At a social level, language involves joint attention to environment, expectations and patterns.
  • Attention serves as a foundation for social trust
  • Hence, AGI needs a linguistic basis – but that needs attention and attention needs context. So, GPT-3 – linguistic – attention – context could lead to AGI-like behaviour

Does AGI need to be conscious as we know it or would access consciousness suffice?

In this context, a recent paper

A Roadmap for Artificial General Intelligence: Intelligence, Knowledge, and Consciousness: Garrett Mindt and Carlos Montemayor

https://www.academia.edu/43620181/A_Roadmap_for_Artificial_General_… makes an argument is that

  • integrated information in the form of attention suffices for AGI
  • AGI must be understood in terms of epistemic agency, (epistemic = relating to knowledge or the study of knowledge) and
  • Eepistemic agency necessitates access consciousness.
  • access consciousness: acquiring knowledge for action, decision-making,  and  thought,  without  necessarily  being  conscious

 

Therefore, the proposal goes that AGI necessitates 

  • selective attention for accessing information relevant to action,  decision-making,  memory  and    
  • But not necessarily consciousness as we know it

 

This line of thinking leads to many questions

  • Is consciousness necessary for AGI?
  • If so, should that consciousness be the same as human consciousness
  • Intelligence is typically understood in terms of problem-solving. Problem solving by definition leads to specialized mode of evaluation. Such tests are easy to formulate but check for compartmentalized competency (which cannot be called intelligence). They also do not allow intelligence to ‘spill over’ from one domain to another – as it does in human intelligence. 
  • Intelligence needs information to be processed in a contextually relevant way.
  • Can we use epistemic  agency  through  attention as the distinctive mark of general intelligence even without consciousness? (as per Garrett Mindt and Carlos Montemayor)
  • In this model, AGI is based on joint attention to preferences in a context sensitive way.
  • Would AI be a peer or subservient in the joint attention model?

Finally, let us consider the question of spillover of intelligence. In my view, that is another characteristic of AGI. Its not easy to quantify because tests are specific to problem types currently. A recent example of spillover of intelligence is from facebook AI supposedly inventing it’s own secret language. The media would have you believe that groups of AGI are secretly plotting to take over humanity. But the reality is a bit mundane as explained. The truth behind facebook AI inventing a new language

In a nutshell, the system was using Reinforcement learning. Facebook was trying to create a robot that could negotiate. To do this, facebook let two instances of the robot negotiate with each other – and learn from each other. The only measure of their success was how well they transacted objects. The only rule to follow was to put words on the screen. As long as they were optimizing the goal(negotiating) and understood each other it did not matter that the language was accurate (or indeed was English). Hence, the news about ‘inventing a new language’. But to me, the real question is: does it represent intelligence spillover?

Much of future AI could be in that direction.

To Conclude

We are left with some key questions:  

  • Does AGI need consciousness or access consciousness?
  • What is role of language in intelligence?
  • GPT3 has reopened the discussion but still hype and dichotomy (both don’t help because hype misdirects discussion and dichotomy shuts down discussion)
  • Does the ‘Bitter lesson’ apply? If so, what are its implications?
  • Will AGI see a take-off point like Google translate did?
  • What is the future of bias reduction other than what we see today?
  • Can bias reduction improve human insight and hence improve Joint attention?
  • GPT-3 – linguistic – attention – context
  • If context is the key, what other ways can be to include context?
  • Does problem solving compartmentalize intelligence?
  • Are we comfortable with the ‘spillover’ of intelligence in AI? – like in the facebook experiment

 

References

https://towardsdatascience.com/gpt-3-the-first-artificial-general-i…

https://www.gwern.net/GPT-3

http://haggstrom.blogspot.com/2020/06/is-gpt-3-one-more-step-toward…

On GPT-3, OpenAI, and APIs

https://www.datasciencecentral.com/profiles/blogs/what-is-s-driving…

The untold story of GPT-3 is the transformation of OpenAI

https://aidevelopmenthub.com/joscha-bach-on-gpt-3-achieving-agi-mac…

https://medium.com/@ztalib/gpt-3-and-the-future-of-agi-8cef8dc1e0a1

https://www.everestgrp.com/2020-08-gpt-3-accelerates-ai-progress-bu…

https://www.theverge.com/21346343/gpt-3-explainer-openai-examples-e…

https://www.theguardian.com/commentisfree/2020/aug/01/gpt-3-an-ai-g…

Philosophers On GPT-3 (updated with replies by GPT-3)

https://marginalrevolution.com/marginalrevolution/2020/07/gpt-3-etc…

https://artificialintelligence-news.com/2020/09/10/experts-misleadi…

https://analyticsindiamag.com/gpt-3-is-great-but-not-without-shortc…

https://www.3mhisinsideangle.com/blog-post/ai-talk-gpt-3-mega-langu…

https://venturebeat.com/2020/06/01/ai-machine-learning-openai-gpt-3…

https://discourse.numenta.org/t/gpt3-or-agi/7805

Is this AGI?

https://www.quora.com/Can-we-achieve-AGI-by-improving-GPT-3

https://bmk.sh/2020/08/17/Building-AGI-Using-Language-Models/

https://news.ycombinator.com/item?id=23891226

 

image source: Learn English Words: DICHOTOMY


Credit: Data Science Central By: ajit jaokar

Previous Post

Video Surfaces of Joe Biden Calling Troops ‘Dull, Stupid Bastards’

Next Post

Always Home Cam: Amazon's robot drone flying inside our homes seems like a bad idea

Related Posts

How Artificial Intelligence Can Benefit Education
Data Science

How Artificial Intelligence Can Benefit Education

January 15, 2021
All about Use Of Data Science
Data Science

All about Use Of Data Science

January 13, 2021
20 Of The Most Important Machine Learning Interview Questions and Answers
Data Science

20 Of The Most Important Machine Learning Interview Questions and Answers

January 12, 2021
How poor data quality impacts your business?
Data Science

How poor data quality impacts your business?

January 12, 2021
FinTech: How AI is Improving This Industry
Data Science

FinTech: How AI is Improving This Industry

January 12, 2021
Next Post
Always Home Cam: Amazon’s robot drone flying inside our homes seems like a bad idea

Always Home Cam: Amazon's robot drone flying inside our homes seems like a bad idea

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

NSA warns against using DoH inside enterprise networks
Internet Security

NSA warns against using DoH inside enterprise networks

January 16, 2021
NSA Suggests Enterprises Use ‘Designated’ DNS-over-HTTPS’ Resolvers
Internet Privacy

NSA Suggests Enterprises Use ‘Designated’ DNS-over-HTTPS’ Resolvers

January 16, 2021
Machine Learning Algorithms To Help Identify, Study, and Predict Earthquakes
Machine Learning

Machine Learning Algorithms To Help Identify, Study, and Predict Earthquakes

January 16, 2021
Joker’s Stash, the internet’s largest carding forum, is shutting down
Internet Security

Joker’s Stash, the internet’s largest carding forum, is shutting down

January 16, 2021
Joker’s Stash, The Largest Carding Marketplace, Announces Shutdown
Internet Privacy

Joker’s Stash, The Largest Carding Marketplace, Announces Shutdown

January 16, 2021
Key Factors to Keep in Mind before Selecting an AutoML Platform
Machine Learning

Key Factors to Keep in Mind before Selecting an AutoML Platform

January 16, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • NSA warns against using DoH inside enterprise networks January 16, 2021
  • NSA Suggests Enterprises Use ‘Designated’ DNS-over-HTTPS’ Resolvers January 16, 2021
  • Machine Learning Algorithms To Help Identify, Study, and Predict Earthquakes January 16, 2021
  • Joker’s Stash, the internet’s largest carding forum, is shutting down January 16, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates