The Naked Scientists
  • Login
  • Register
  • Podcasts
      • The Naked Scientists
      • eLife
      • Naked Genetics
      • Naked Astronomy
      • In short
      • Naked Neuroscience
      • Ask! The Naked Scientists
      • Question of the Week
      • Archive
      • Video
      • SUBSCRIBE to our Podcasts
  • Articles
      • Science News
      • Features
      • Interviews
      • Answers to Science Questions
  • Get Naked
      • Donate
      • Do an Experiment
      • Science Forum
      • Ask a Question
  • About
      • Meet the team
      • Our Sponsors
      • Site Map
      • Contact us

User menu

  • Login
  • Register
  • Home
  • Help
  • Search
  • Tags
  • Recent Topics
  • Login
  • Register
  1. Naked Science Forum
  2. General Science
  3. General Science
  4. How does ChatGPT work?
« previous next »
  • Print
Pages: 1 ... 5 6 [7] 8 9   Go Down

How does ChatGPT work?

  • 179 Replies
  • 168774 Views
  • 7 Tags

0 Members and 35 Guests are viewing this topic.

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #120 on: 14/02/2024 10:10:12 »
Quote from: Eternal Student on 10/02/2024 15:13:02
Ask ChatGPT to create some HTML code for a standard log in page of a website that your building and you'll get similar instantly useable results.
The interesting question is whether it is writing from scratch or searching for examples of the requested code. If the latter, you still need to check for any clash of variables, like using x to mean two different things or calling for a variable that doesn't exist, when you embed the new patch in something bigger.

This might explain why Companies House and BT email  are now full of bugs and the County Court claim filing system is incompatible with Explorer: updates written by an unaccountable (but very expensive, naturally) idiot! Or Fujitsu.
Logged
Helping stem the tide of ignorance
 



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #121 on: 15/02/2024 21:13:10 »
Quote from: alancalverd on 14/02/2024 10:10:12
The interesting question is whether it is writing from scratch or searching for examples of the requested code. If the latter, you still need to check for any clash of variables, like using x to mean two different things or calling for a variable that doesn't exist, when you embed the new patch in something bigger.
You can simply ask it. You can also ask it to check.
Logged
Unexpected results come from false assumptions.
 

Offline Zer0

  • Naked Science Forum King!
  • ******
  • 1932
  • Activity:
    0%
  • Thanked: 232 times
  • Email & Nickname Alerts Off! P.M. Blocked!
Re: How does ChatGPT work?
« Reply #122 on: 16/02/2024 16:00:35 »

Copyrights & Credits -
BBC News/Youtube.

ps - If a Picture says a Thousand words...
Maybe a Video could say More.
Logged
1N73LL1G3NC3  15  7H3  481L17Y  70  4D4P7  70  CH4NG3.
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #123 on: 16/02/2024 22:08:48 »
Solar power is the most economic power source. Any massive usage of energy will make it the first option, in order to be more competitive. Other power sources are likely to be the back up, and will be used only when the primary power source fails.
Logged
Unexpected results come from false assumptions.
 

Offline Zer0

  • Naked Science Forum King!
  • ******
  • 1932
  • Activity:
    0%
  • Thanked: 232 times
  • Email & Nickname Alerts Off! P.M. Blocked!
Re: How does ChatGPT work?
« Reply #124 on: 19/02/2024 16:16:19 »
& perhaps whether We even should power it On, on such massive scales, or give it more Time for refinement inorder for IT to get things Right is also an Option which could be taken into consideration.

The BBC Guest seemed to be mildly opinionated about AI.

But She did say something quite important & necessary...
" Trust = T.E.A. "
(Trustability Explainability Accountability)

T

https://www.theguardian.com/commentisfree/2024/feb/13/software-student-cheated-combat-ai

(it creates trust issues)

E

https://theconversation.com/why-humans-cant-trust-ai-you-dont-know-how-it-works-what-its-going-to-do-or-whether-itll-serve-your-interests-213115

(a bit too many unknowns)

A

https://www.forbes.com/sites/marisagarcia/2024/02/19/what-air-canada-lost-in-remarkable-lying-ai-chatbot-case/

(the law which is the law is the law)

ps - enough words, now time to wait & watch, how the future unfolds.
: )
Logged
1N73LL1G3NC3  15  7H3  481L17Y  70  4D4P7  70  CH4NG3.
 



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #125 on: 02/03/2024 10:23:53 »
Quote
As a seasoned ChatGPT user, you're familiar with the insights and assistance a single Language Model can provide. But what if you could harness the collective capabilities of SIX different Large Language Models at once?

Check Out Chathub and Change the Way you Use LLMs!
Logged
Unexpected results come from false assumptions.
 

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #126 on: 02/03/2024 15:59:57 »
Quote from: hamdani yusuf on 02/03/2024 10:23:53
As a seasoned ChatGPT user, you're familiar with the insights and assistance a single Language Model can provide
So far, no evidence of insight, just uncritical mashups of stuff that's already out there.
Logged
Helping stem the tide of ignorance
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #127 on: 03/03/2024 05:01:29 »
Quote from: alancalverd on 02/03/2024 15:59:57
Quote from: hamdani yusuf on 02/03/2024 10:23:53
As a seasoned ChatGPT user, you're familiar with the insights and assistance a single Language Model can provide
So far, no evidence of insight, just uncritical mashups of stuff that's already out there.
Tell that to those who've just got laid off from their jobs, related to increasing use of AI.
Logged
Unexpected results come from false assumptions.
 
The following users thanked this post: Zer0

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #128 on: 03/03/2024 15:21:30 »
Nothing new there.

25 years ago one of my children's college friends got a summer vacation job with an airline freight handler, initially entering data into a spreadsheet.  He quickly realised that with a few extra command lines he could get the spreadsheet to do all the rest of his work, so he sat at his desk for a few weeks watching the computer earn his wages. Then it occurred to him that he could replace everyone else in the office with a bit more software. Moral problem: tell the boss, get promoted and make 5 other guys redundant, or stay stumm and come back at Christmas?
Logged
Helping stem the tide of ignorance
 
The following users thanked this post: Zer0



Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #129 on: 04/03/2024 22:04:56 »
However you see it, the machines seem to have growth rate much higher than their biological counterparts.
Quote
Anthropic just dropped Claude 3, a cutting-edge model that performs better than GPT4 across the board, according to benchmarks. I'll tell you all about it, and then we'll test it ourselves!

Chapters:
0:00​ - About Claude 3
8:35​ - Pricing & Use Cases
10:47​ - Testing
Logged
Unexpected results come from false assumptions.
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #130 on: 02/04/2024 10:54:38 »
But what is a GPT? Visual intro to Transformers | Deep learning, chapter 5
Quote
Timestamps

0:00 - Predict, sample, repeat
3:03 - Inside a transformer
6:36 - Chapter layout
7:20 - The premise of Deep Learning
12:27 - Word embeddings
18:25 - Embeddings beyond words
20:22 - Unembedding
22:22 - Softmax with temperature
26:03 - Up next
Logged
Unexpected results come from false assumptions.
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #131 on: 13/07/2024 09:46:22 »
Coding a ChatGPT Like Transformer From Scratch in PyTorch
Quote
In this StatQuest we walk through the code required to code your own ChatGPT like Transformer in PyTorch and we do it one step at a time, with every little detail clearly explained.

0:00 Awesome song and introduction
1:12 Loading the modules
2:04 Creating the training dataset
6:17 Coding Position Encoding
14:09 Coding Attention
21:04 Coding a Decoder-Only Transformer
26:39 Running the model (untrained)
29:18 Training and using the model

It's said that the ability to create is the highest level of thinking.
« Last Edit: 13/07/2024 14:23:01 by hamdani yusuf »
Logged
Unexpected results come from false assumptions.
 

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #132 on: 13/07/2024 14:44:29 »
Said by those who create, presumably. But create what, and why? The higher form of thinking is to establish a clear need and specification - nailing the bits together doesn't involve judgement or visualising context.
Logged
Helping stem the tide of ignorance
 



Offline varsigma

  • Sr. Member
  • ****
  • 412
  • Activity:
    0%
  • Thanked: 24 times
  • Naked Science Forum Newbie
Re: How does ChatGPT work?
« Reply #133 on: 15/07/2024 00:32:05 »
What I think we might eventually see is an AI able to 'create' programs that it can prove are correct.

Why that is is because humans can do it already and all you need is logic. Induction and whatnot.
So to me, that will be down to being able to train some AI to use predicate logic and induction on some invariants, of loops and branches in the algorithms, however these are presented.

The faculty had cobbled together a "program logic" and embedded it as Java in C++, as "comments" (erm, yeah another course I did). But an AI would in a sense, be that embedded code.
Logged
 

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #134 on: 15/07/2024 15:40:56 »
Quote from: alancalverd on 13/07/2024 14:44:29
Said by those who create, presumably. But create what, and why? The higher form of thinking is to establish a clear need and specification - nailing the bits together doesn't involve judgement or visualising context.
It's Bloom's Taxonomy.
Logged
Unexpected results come from false assumptions.
 

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #135 on: 15/07/2024 17:10:09 »
Quote from: hamdani yusuf on 16/08/2023 04:27:32
At some point, future AI models will be able to rewrite its own source code.
Thus rendering the bot legally liable for whatever it says or does. But does it have any money to pay damages? If not, then the liability will lie with whoever deployed it. Users beware - you may be liable for unlimited damages incurred by a machine over which you have no control.

A sound legal precedent, where a manufacturer of a defective product went bankrupt, has famously led to the prohibition of using any Dupont material in a medical device.
Logged
Helping stem the tide of ignorance
 
The following users thanked this post: paul cotter

Offline hamdani yusuf

  • Naked Science Forum GOD!
  • *******
  • 11801
  • Activity:
    91%
  • Thanked: 285 times
Re: How does ChatGPT work?
« Reply #136 on: 16/07/2024 05:26:30 »
Quote from: alancalverd on 15/07/2024 17:10:09
Quote from: hamdani yusuf on 16/08/2023 04:27:32
At some point, future AI models will be able to rewrite its own source code.
Thus rendering the bot legally liable for whatever it says or does. But does it have any money to pay damages? If not, then the liability will lie with whoever deployed it. Users beware - you may be liable for unlimited damages incurred by a machine over which you have no control.

A sound legal precedent, where a manufacturer of a defective product went bankrupt, has famously led to the prohibition of using any Dupont material in a medical device.
Don't confuse ability with permission. Many people are able to drive cars while not having license, or not having license to drive in some certain area.
Many people are able to kill someone. It doesn't mean that they're allowed to.

Manufacturers are expected to meet users' requirements. When the system affects wider society, regulations are needed to set the standard for minimum requirements.
« Last Edit: 16/07/2024 05:31:10 by hamdani yusuf »
Logged
Unexpected results come from false assumptions.
 



Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #137 on: 16/07/2024 09:36:28 »
The required regulation here is that the originator of any AI system is liable for any unintended consequence of its deployment if the end user does not have the resources to compensate victims, or cannot reasonably be held to have prior knowledge of the likelihood of such consequences.

There's plenty of precedent: it is illegal to drive a car without third party insurance, and the manufacturer is liable for any inherent fault that causes harm. The only glaring oddity is the constitutional right of third-world citizens to kill each other with guns.
Logged
Helping stem the tide of ignorance
 

Offline paul cotter

  • Naked Science Forum King!
  • ******
  • 2318
  • Activity:
    31.5%
  • Thanked: 260 times
  • forum grump
Re: How does ChatGPT work?
« Reply #138 on: 16/07/2024 11:09:18 »
A couple of very minor disagreements, otherwise i'm in full agreement. (1) In general motor vehicle insurance is obligatory with one notable exception: in New Zealand there are alternatives to insurance but it is still recommended. (2) In the US it seems that murder via firearms could soon become state sanctioned- shoot all shoplifters!!
Logged
Did I really say that?
 

Offline alancalverd

  • Global Moderator
  • Naked Science Forum GOD!
  • ********
  • 21150
  • Activity:
    72.5%
  • Thanked: 60 times
  • Life is too short for instant coffee
Re: How does ChatGPT work?
« Reply #139 on: 16/07/2024 14:13:56 »
And of course the US President is now exonerated from all criminal charges when in office.
Logged
Helping stem the tide of ignorance
 



  • Print
Pages: 1 ... 5 6 [7] 8 9   Go Up
« previous next »
Tags: deepmind  / chatgpt  / openai  / machine learning  / neural networks  / artificial intelligence  / ai safety 
 
There was an error while thanking
Thanking...
  • SMF 2.0.15 | SMF © 2017, Simple Machines
    Privacy Policy
    SMFAds for Free Forums
  • Naked Science Forum ©

Page created in 0.543 seconds with 73 queries.

  • Podcasts
  • Articles
  • Get Naked
  • About
  • Contact us
  • Advertise
  • Privacy Policy
  • Subscribe to newsletter
  • We love feedback

Follow us

cambridge_logo_footer.png

©The Naked Scientists® 2000–2017 | The Naked Scientists® and Naked Science® are registered trademarks created by Dr Chris Smith. Information presented on this website is the opinion of the individual contributors and does not reflect the general views of the administrators, editors, moderators, sponsors, Cambridge University or the public at large.