The Naked Scientists
  • Login
  • Register
  • Podcasts
      • The Naked Scientists
      • eLife
      • Naked Genetics
      • Naked Astronomy
      • In short
      • Naked Neuroscience
      • Ask! The Naked Scientists
      • Question of the Week
      • Archive
      • Video
      • SUBSCRIBE to our Podcasts
  • Articles
      • Science News
      • Features
      • Interviews
      • Answers to Science Questions
  • Get Naked
      • Donate
      • Do an Experiment
      • Science Forum
      • Ask a Question
  • About
      • Meet the team
      • Our Sponsors
      • Site Map
      • Contact us

User menu

  • Login
  • Register
  • Home
  • Help
  • Search
  • Tags
  • Recent Topics
  • Login
  • Register
  1. Naked Science Forum
  2. General Science
  3. General Science
  4. How does ChatGPT work?
« previous next »
  • Print
Pages: 1 ... 3 4 [5] 6 7 ... 9   Go Down

How does ChatGPT work?

  • 179 Replies
  • 165769 Views
  • 7 Tags

0 Members and 24 Guests are viewing this topic.

Offline yor_on

  • Naked Science Forum GOD!
  • *******
  • 81477
  • Activity:
    100%
  • Thanked: 178 times
  • (Ah, yes:) *a table is always good to hide under*
Re: How does ChatGPT work?
« Reply #80 on: 05/09/2023 15:59:40 »
I don't think so, no more than expecting people with different ideologies, upbringings, ideals, values and beliefs to be able to convince each other that only one of them have the truth. It's easier with pure logic, but logic is just one small part of what those AI's will meet.

Although you can use logic to test ideas, and use references to crosscheck differing views with facts, well, as far as possible, even logic has limitations.
Logged
URGENT:  Naked Scientists website is under threat.    https://www.thenakedscientists.com/sos-cambridge-university-killing-dr-chris

"BOMB DISPOSAL EXPERT. If you see me running, try to keep up."
 
The following users thanked this post: Zer0



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #81 on: 06/09/2023 13:12:13 »
Quote from: yor_on on 05/09/2023 15:59:40
I don't think so, no more than expecting people with different ideologies, upbringings, ideals, values and beliefs to be able to convince each other that only one of them have the truth. It's easier with pure logic, but logic is just one small part of what those AI's will meet.
I mentioned GAN to specifically answer your concern about inability to question itself. For it to work, it needs access to the ground truths. For games like chess and go, the AI agents need to know all allowed moves, and conditions required for a win. They may not be entirely available in real life problems.
Logged
Unexpected results come from false assumptions.
 

Offline Zer0

  • Naked Science Forum King!
  • ******
  • 1932
  • Activity:
    0%
  • Thanked: 232 times
  • Email & Nickname Alerts Off! P.M. Blocked!
Re: How does ChatGPT work?
« Reply #82 on: 10/09/2023 19:45:48 »
Logic is Not Everything!

If I'm playing Chess against a 6yr young on her Birthday...
I might be Undecided on which moves i shall play..
But certainly Not Indecisive on the End result of the Game.

Hopefully, it shall come under International Laws for an A.I. system to confirm it's identity as an AI.

ps - Not Everybody is into Bigger, Faster, Better etc.
Some are Nostalgic & prefer the old skool ways.
Logged
1N73LL1G3NC3  15  7H3  481L17Y  70  4D4P7  70  CH4NG3.
 

Offline Karen W.

  • Moderator
  • Naked Science Forum GOD!
  • *****
  • 31886
  • Activity:
    0%
  • Thanked: 41 times
  • "come fly with me"
Re: How does ChatGPT work?
« Reply #83 on: 13/09/2023 14:08:00 »
Quote from: hamdani yusuf on 29/04/2023 08:17:39
Here's a first hand information intended for general audience.

The Inside Story of ChatGPT’s Astonishing Potential | Greg Brockman | TED


Quote
In a talk from the cutting edge of technology, OpenAI cofounder Greg Brockman explores the underlying design principles of ChatGPT and demos some mind-blowing, unreleased plug-ins for the chatbot that sent shockwaves across the world. After the talk, head of TED Chris Anderson joins Brockman to dig into the timeline of ChatGPT's development and get Brockman's take on the risks, raised by many in the tech industry and beyond, of releasing such a powerful tool into the world.
Thank you... That's very Interesting and quite exciting really. My friend was just telling me about this and I find it fascinating!
Logged

"Life is not measured by the number of Breaths we take, but by the moments that take our breath away."
 
The following users thanked this post: hamdani yusuf

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #84 on: 16/09/2023 09:41:51 »
ChatGPT is getting better quickly.

OpenAI?s ChatGPT Nails 150+ Difficult Tasks!
The paper "Reflexion: Language Agents with Verbal Reinforcement Learning" is available here:
https://arxiv.org/abs/2303.11366
Logged
Unexpected results come from false assumptions.
 



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #85 on: 30/09/2023 03:43:01 »
Here's how it works from a more hardware oriented perspective. It's valuable to learn from a first hand information.
What runs ChatGPT? Inside Microsoft's AI supercomputer | Featuring Mark Russinovich
Quote
Get an inside look at the AI supercomputer infrastructure built to run ChatGPT and other large language models, and see how to leverage it for your workloads in Azure, at any scale.

Go behind the scenes:
-For how we collaborated with NVIDIA to deliver purpose-built AI infrastructure with NVIDIA GPUs
-How Project Forge checkpointing works to restore job states if a long training job fails or needs to be migrated
-How we used LoRA fine-tuning to update a fraction of the base model for more training throughput and smaller checkpoints
-How UK-based company, Wayve, is using Azure's AI supercomputer infrastructure for self-driving cars
-And how Confidential Computing works with Azure AI to combine datasets without sharing personally identifiable information for secure multiparty collaborations.

Mark Russinovich, Azure CTO, joins Jeremy Chapman to break it down.

► QUICK LINKS:
00:00 - Introduction
01:15 - AI innovation building specialized hardware and software
04:22 - Optimizing hardware
05:40 - Improved throughput
06:17 - Project Forge
08:01 - Project Forge checkpointing demo
10:02 - LoRA fine tuning
11:29 - Use AI supercomputer infrastructure for your workloads
12:34 - How Wayve is leveraging AI supercomputer infrastructure
​​13:47 - How Confidential Computing works with Azure AI
15:21 - Wrap up

► Link References:

Leverage Azure AI capabilities for yourself at https://aka.ms/AzureAIInfrastructure
Logged
Unexpected results come from false assumptions.
 

Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #86 on: 30/09/2023 09:29:04 »
Quote from: hamdani yusuf on 30/08/2023 12:01:36
Quote from: alancalverd on 30/08/2023 10:32:26
If a robot rips off your arm instead of washing your face (like a human, it's quite capable of doing either) who do you sue?
It depends on the circumstances.
Am I the one who designed and was testing the robot?
no
Quote
Has the robot been tested and passed regulations?
Was it used according to designated functions?
Was it properly maintained?

and yes to the rest. Now please answer the question.
Logged
Helping stem the tide of ignorance
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #87 on: 30/09/2023 13:35:05 »
Quote from: alancalverd on 30/09/2023 09:29:04
Quote from: hamdani yusuf on 30/08/2023 12:01:36
Quote from: alancalverd on 30/08/2023 10:32:26
If a robot rips off your arm instead of washing your face (like a human, it's quite capable of doing either) who do you sue?
It depends on the circumstances.
Am I the one who designed and was testing the robot?
no
Quote
Has the robot been tested and passed regulations?
Was it used according to designated functions?
Was it properly maintained?

and yes to the rest. Now please answer the question.

It means that the regulations aren't strong enough. I can sue the tester or regulator. Or blame myself for trusting them.
But don't forget that human workers also have non-zero probability to do crazy things. They can burn down entire city. Who would you sue in that case?
Logged
Unexpected results come from false assumptions.
 

Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #88 on: 01/10/2023 00:48:12 »
Quote from: hamdani yusuf on 30/09/2023 13:35:05
I can sue the tester or regulator.
You might sue the tester if you had reason to believe that the test results were falsified, but your case would fail if the incident was outside the scope of the test parameters, or if it was within the scope but the machine had performed correctly on test. Regulation isn't a guarantee of safety or performance - its function is to create a common market.

Quote
But don't forget that human workers also have non-zero probability to do crazy things. They can burn down entire city. Who would you sue in that case?
You sue the person who did the deed. That's the law.

Boeing have offered compensation over the 737MAX disasters, because the entire system was designed in-house to overcome a "problem" resulting from their own design. But it was a simple, dumb system designed to consistently convert one input into one output. Who is liable for  the actions of a system developed by countless others with the intention of learning and reprogramming itself, years after anyone who might be considered the originator has died or gone bankrupt?
Logged
Helping stem the tide of ignorance
 



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #89 on: 01/10/2023 05:26:54 »
Quote from: alancalverd on 01/10/2023 00:48:12
You sue the person who did the deed. That's the law.
What if they commit suicide afterwards?
Logged
Unexpected results come from false assumptions.
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #90 on: 01/10/2023 05:27:53 »
Quote from: alancalverd on 01/10/2023 00:48:12
You might sue the tester if you had reason to believe that the test results were falsified, but your case would fail if the incident was outside the scope of the test parameters, or if it was within the scope but the machine had performed correctly on test. Regulation isn't a guarantee of safety or performance - its function is to create a common market.
Then I can only blame myself.
Logged
Unexpected results come from false assumptions.
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #91 on: 01/10/2023 05:38:54 »
Quote from: alancalverd on 01/10/2023 00:48:12
Who is liable for  the actions of a system developed by countless others with the intention of learning and reprogramming itself, years after anyone who might be considered the originator has died or gone bankrupt?
That would leave the users to be responsible for their decisions, just like normal investments. There's no guarantee that your investment will get to break even. I heard that 80% of start ups fail.
They must consider cost and benefits, as well as their probability to fail or succeed. If they decided to not use AI, they are in a risk of being out competedcompeted and lose their money.
Logged
Unexpected results come from false assumptions.
 

Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #92 on: 01/10/2023 10:07:52 »
So every "care robot" or selfdriving car must come with a clear warning "This machine might decide to kill you. The supplier accepts no responsibility." Like cigarettes, but with consciousness!
Logged
Helping stem the tide of ignorance
 



Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #93 on: 01/10/2023 10:12:23 »
Quote from: hamdani yusuf on 01/10/2023 05:26:54
Quote from: alancalverd on 01/10/2023 00:48:12
You sue the person who did the deed. That's the law.
What if they commit suicide afterwards?
In the first instance, you (or your executors) sue their estate. There have been more complex cases where the manufacturer of a single product has gone bankrupt and the courts have upheld a suit against the company that supplied the raw materials, even though those were entirely to specification. One result is that you now can't use any DuPont material in a medical device.
Logged
Helping stem the tide of ignorance
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #94 on: 04/10/2023 08:11:52 »
Google Bard is not ChatGPT, but they use similar technology.
I asked it, what's the difference between design pressure and MAWP?
Here's the answer.
Quote
Design pressure is the highest pressure that a pressure vessel or other equipment is designed to withstand under normal operating conditions. It is calculated using a variety of factors, including the material of construction, the thickness of the vessel walls, and the safety factor.

MAWP, or Maximum Allowable Working Pressure, is the highest pressure that the equipment is allowed to operate at under any circumstances. It is typically set by the manufacturer or by a regulatory body, and it is always equal to or less than the design pressure.

The difference between design pressure and MAWP is a safety margin. This margin of safety is necessary to account for unexpected pressure surges, corrosion, and other factors that could weaken the equipment over time.

Here is a table summarizing the key differences between design pressure and MAWP:

Definition   
D: The highest pressure that the equipment is designed to withstand under normal operating conditions.   
M: The highest pressure that the equipment is allowed to operate at under any circumstances.

Calculation   
D: Calculated using a variety of factors, including the material of construction, the thickness of the vessel walls, and the safety factor.   
M: Typically set by the manufacturer or by a regulatory body.

Relationship   
D: Always equal to or less than MAWP.   
M: Always equal to or less than design pressure.

Purpose   
D: To ensure the safety of the equipment and its operators.   
M: To provide a safety margin in case of unexpected pressure surges, corrosion, and other factors.

Examples:

A pressure vessel is designed to operate at a pressure of 100 psi. The manufacturer sets the MAWP at 90 psi to provide a safety margin.
A pipeline is designed to withstand a pressure of 200 psi. The regulatory body sets the MAWP at 180 psi to provide a safety margin.
It is important to note that the MAWP should never be exceeded. Operating the equipment at a pressure above the MAWP could result in failure of the equipment and serious injury or death.
It doesn't seem to be aware of contradiction, as boldened statements above. This weakness needs to be fixed.
Logged
Unexpected results come from false assumptions.
 

Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #95 on: 04/10/2023 16:36:35 »
Which is why every decision must be traceable to a human or corporation that can be held liable for the consequences. Except, of course, politicians, priests, and economists.
Logged
Helping stem the tide of ignorance
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #96 on: 05/10/2023 10:00:53 »
Quote from: alancalverd on 04/10/2023 16:36:35
Which is why every decision must be traceable to a human or corporation that can be held liable for the consequences. Except, of course, politicians, priests, and economists.
Or when they are already dead.
Logged
Unexpected results come from false assumptions.
 



Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #97 on: 05/10/2023 11:31:14 »
A dead person or corporation can still be held liable for what they did when alive, and compensation can be sought from their estate or corporate successors When you buy a company, you buy its assets and liabilities.

I don't understand why Matt Hancock hasn't been sued over the deaths of those he mandated to be infected with COVID.
Logged
Helping stem the tide of ignorance
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11799
  • Activity:
    92.5%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #98 on: 06/10/2023 04:49:57 »
Quote from: alancalverd on 05/10/2023 11:31:14
A dead person or corporation can still be held liable for what they did when alive, and compensation can be sought from their estate or corporate successors When you buy a company, you buy its assets and liabilities.

I don't understand why Matt Hancock hasn't been sued over the deaths of those he mandated to be infected with COVID.
It's their heirs you're talking about.
Logged
Unexpected results come from false assumptions.
 

Online alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21147
  • Activity:
    71.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #99 on: 06/10/2023 15:19:03 »
No, their estate.The estate is the sum of monetisable assets that belonged to the deceased person. The heirs are the people to whom, after all prior claims have been settled, some or all of the assets have been bequeathed. Whether a claim can be retrospectively prioritised is, I think, dubious, but in any case the essence of all legal proceedings is to file your claim ASAP! In the case of a corporation purchased by another, the liabilities are transferred in the same way as the claims on a personal estate.
Logged
Helping stem the tide of ignorance
 



  • Print
Pages: 1 ... 3 4 [5] 6 7 ... 9   Go Up
« previous next »
Tags: deepmind  / chatgpt  / openai  / machine learning  / neural networks  / artificial intelligence  / ai safety 
 
There was an error while thanking
Thanking...
  • SMF 2.0.15 | SMF © 2017, Simple Machines
    Privacy Policy
    SMFAds for Free Forums
  • Naked Science Forum ©

Page created in 0.594 seconds with 68 queries.

  • Podcasts
  • Articles
  • Get Naked
  • About
  • Contact us
  • Advertise
  • Privacy Policy
  • Subscribe to newsletter
  • We love feedback

Follow us

cambridge_logo_footer.png

©The Naked Scientists® 2000–2017 | The Naked Scientists® and Naked Science® are registered trademarks created by Dr Chris Smith. Information presented on this website is the opinion of the individual contributors and does not reflect the general views of the administrators, editors, moderators, sponsors, Cambridge University or the public at large.