Geoff: Hello, good morning, good evening, good day and welcome wherever you are in the world today. Welcome to To Quality Over Coffee episode number 11. We know you love Pete and I chatting, but today we have a special guest to join the chat. If you listen to episode seven, you would have heard me discussing a presentation at Eurostar given by a guy called Chris Ambler entitled, Is psychology the next major testing skill for AI? A fascinating talk. about new skills that testers will need in an AI world. So I asked him to come along and chat us through his thoughts. I'd therefore like to welcome Chris Ambler to Quality Over Coffee. Chris, I'm sure that many of our listeners know who you are already or are aware of you, but for those who don't know you, please introduce yourself. Chris Ambler: Thanks ever so much. I've been around in the IT industry for about 46 years. Really most of, well all of my career really has been around what started off as data processing. It wasn't even called IT when I started and it was basically working on machines that didn't even have the screens. was all... lights and switches and all of that sort of stuff. So I've sort of grown up all the way through all of the IT revolutions, if you like, throughout mainframe moving into client server machines, the introduction of the internet, wireless, bring your own devices, big data, all of those sorts of things. I've been involved in the development of, and more importantly, the testing of. The last I retired from my day job about probably about 10 years ago, but the last 10, 12 years or so of my working life was in the video games industry. I was at basically the European QA director for Electronic Arts and then I became the European QA director for Microsoft Game Studios. And interestingly, they're very relevant in what I'm doing now because that was the first time that I'd had the opportunity to work in virtual worlds and start to understand the way people think about virtual worlds and sometimes how passionate they can be about these virtual worlds and the way things are done. I was very involved in things like setting up the connect setting and testing the connect system on Xbox, you know, whole using your hands and voice and Geoff: Hmm. Chris Ambler: that was sort of got into this idea of what I called at the time four dimensional testing, which also didn't involve just in doing the linear idea and software of pressing buttons on a console. It was more about environments, was about heat, was about light, was about whether or not the system could recognise tattoo ink or facial jewellery, how it was understanding different accents and all of those sorts of things. So I got very involved in the people side of trying to relate to computer systems. through the games environment which I think was a really, really useful thing to do. Anyway, I decided at the age of about 55 that I've had enough of working for the man. I was sick of travelling, was sick of moving around and trying to deliver what other people wanted to deliver. I spent a little bit of time just in the wilderness I suppose more than anything not really doing very much of anything but then like everybody well maybe not like everybody but certainly from my perspective I started to get bored so I started to I'll make a statement here which is probably quite weird but I sort of got to a I got to a point in my career where the one thing I didn't like doing was managing people. I've always enjoyed the sort of the task, the project, the program side of life but what I found is as you get good at what you do you get promoted and eventually you get promoted into a situation where you're not doing what you enjoy doing anymore you're trying to manage other people to do what they like doing and I didn't like that I'm not a big fan of that but one of the things I found once I retired and once I had this period in the wilderness that actually it was the people side actually started to interest me quite a lot so I got more involved in I mean I've always had an interest in AI but I started to get more involved in the concept of AI more or less along the lines of how AI was going to affect people's lives, what it was going to do from a community perspective, what it was going to do from a jobs perspective, how were people going to earn a living if they didn't have jobs, all of those types of things. So I started to look into it a bit and then... got back into doing what I enjoy doing which is going out and talking to people and finding out what they understand and having conversations about things. And I ended up talking to this really, this company in Holland and their MD was a really, really interesting chap. And I talked about, I did this talk about which jobs I thought would disappear first. how that was going affect the world, blah blah blah. He said to me at the end of this, said, that's all really good Chris, but how do we put guardrails into this AI stuff? And it sort of smacked me on the back of the head a little bit because I thought, do you know what, I've never thought about that. And I started to think more about guardrails and thinking about governance and thinking about how we're actually going to control this. the whole idea. Now a year or so after I retired I decided that because of my interest in people I would do a psychology degree. I got a computer science degree back in the 90s as a mature student but I thought I'll take some time through Open University to do a psychology degree. So I did a psychology degree, started to understand a bit more about how people work and The big thing that jumped out at me in relation to AI because that was sort of why I was doing the psychology degree to start trying to understand that link between people and machines and that sort of thing. What I figured is the most important thing that isn't really happening right now is the whole thing about around ethics and around morals and around ethical and moral decision making. So I started researching a little bit about that and at some point, I can't even remember who was who said this to me, but somebody said, you should write a book about this. Because what I tend to do is, you've probably seen it right now, is that when I get a bit of it on it and when I'm interested in something, I don't know whether it's an ADHD thing or whatever it is, but I get quite focused on it. and I was talking to everybody about this stuff that I discovered as the way that people think. So I thought, well yeah, I'll write a book about it. So I spent probably two years just about writing the book, The Psychology of AI Decision Making, and was fortunate enough for it to get picked up by BCS Publishing. So the book was actually published last October by BCS Publishing. So that's out on the market now for anybody who's interested in going out and buying a damn good book. £34.99 from any good book shop. Absolutely. Absolutely. Peter: Ha ha. Geoff: I've played Amazon for many good books. Peter: yeah. All good bookstores and bad ones as well, right? Yeah. Geoff: the Chris Ambler: And I have got a few copies if anybody's interested. So the interesting thing is probably about six months before the book was published I spoke to an author in America. because I was interested in what she published about what that does to your life. And I spoke to this, she said it wasn't about, it's never about book sales. How many you sell is irrelevant really at the end of the day. What matters is you end up with this little tag after your name called published author. That sort of gives you a stamp on your forehead that sort of says you must know something about what you're talking about and what you are what she said and What has actually come true is that once you've got that stamp on your forehead? People talk to you that didn't used to talk to you Because what I found was whenever I was active in the testing industry and I got to a point where people knew who I was and I could go to conferences and people would listen because I had a reputation, I'd spoken a lot. After I'd had five, six years, eight, nine years actually, out of the industry, I sort of thought I could go back into the industry and everybody would go, Chris Ambler's back. And I'd just have that, Peter: Ha ha ha ha. Chris Ambler: I'd have that same following that I used to have. It's a bit like, you know, I made an album for 20 years and all of a sudden I make an album and expect it to sell like it used to. Yeah, absolutely. Geoff: Like you too, you mean? Yeah, that's sort of it. Peter: Yeah. Yes. Yeah. Chris Ambler: So for me, it was really a case of starting again. I had to go out and instead of people ringing me or emailing me and saying Chris would like you to come and speak here I was having to go out and put in proposals for things and not only that but I was putting in proposals for things that people weren't really talking about at the moment and I was having to try to bend what I was doing into areas that I was trying to put the square peg in a round hole basically but I wanted to talk about something that nobody else was really even thinking about. But what I found was once I got this published author stamp it made life a little bit easier and I was I could put things in and say I've got this published book I want to come and talk about it relates to what you're doing like this I had to figure out ways of creating that Geoff: Yep. Chris Ambler: relationship so since the book coming out I've probably done I don't know 20 podcasts and webinars I've spoken. Yeah, absolutely, absolutely. In Geoff: You're everywhere, Chris Ambler: fact, right now, I've got so many things going on in my head right now that I don't know whether I'm coming or going half the time. So I'm actually right now, although I class myself as being retired. I'm probably working harder right now than I ever worked when I was working. But the really good thing about it is I'm doing what I want to do when I want to do it and I'm talking about my passions. I'm not talking about what I'm... I'm not trying to sell a company's guts and goods. And that's what builds that passion. So as far as the Euro style thing was concerned, they're gone. Geoff: Well, actually, because I wanted to say, Chris, you've managed to keep Peter and I quiet for 10 minutes, which is is never before happened. Normally, one of us Peter: Yep. Damn nigh impossible. Geoff: might be quiet, but not both of us. So, yeah, I wanted to just pick up on a few things now, if you don't mind, if you don't mind, Chris, I think Chris Ambler: Yeah, sure, sure. Geoff: it's interesting that you've you sort of started from the position of interested in people, then interested in machines. And I think I probably went through the same thing myself. My last five years, I did everything but take on management responsibility for people because I enjoyed doing something. The one I Chris Ambler: Yeah. Geoff: went home, I could say I've achieved this today. That's not saying I didn't like looking after people, but I preferred doing that. And I like you since I've retired AI has sort of flourished and it's awoken a lot of my interest. And I'm saying for Peter, cause you've had a couple of podcasts, but what was it that triggered? You obviously talked about your book and the psychology thing, but obviously you've got a testing background. But I was going to lead into your Eurostar presentation because what I got from that was that testers have another thing they have to be able to think about when they're testing. If they're testing an AI system, which is things we've never ever had to consider ever before in our lives. And none of that is written down requirements. I'm right, they're just things which I'll leave you to explain in a second. But I was just interested in that journey for how you recognize all this stuff and particularly the ethical side of things because there are so many different ethics. It depends on where you are in the world as to whether those ethics apply to you or not. So how you ever build a system that can test the system that has it's going to be used everywhere. Chris Ambler: The trigger, Geoff: because Chris Ambler: it's funny because the the best analogy I can use is I listen to a really really good interview with Noel Gallagher from Oasis and High Flying Birds because Geoff: Mm-hmm. Chris Ambler: that's my era of music if you like and somebody asked him the question of saying how come you're such a damn good songwriter and how do you get your ideas for songs? and he said, do you know what? said the way that I view it is that these good songs fall out of the sky and there are certain people, are certain human beings who have got the ability to catch these songs when they fall out of the sky not Geoff: Okay. Chris Ambler: everybody can do it it's like you've got a flipped up head that these things can fall into And he said, can look around, you can look at Paul McCartney and John Lennon and you can look at all the really, really top songwriters out there, Jeff Lynn, all of these people, they've got that capability somehow of being able to take a concept and play with it. to make it into something magical or something really really good. Now I'm not saying that what I do is really really magical because it's very practical and to a lot of people it's incredibly boring but I think the concept is the same. I'll wake up at three o'clock in the morning after listening to... I'll give you good example. One of the things I talk about in the book is the elephant and rider. Right? And I mentioned this at EuroStar as well. Geoff: Mm-hmm. You did, yep. Chris Ambler: I hear people all the time saying, why the hell is this guy talking about elephants when we're supposed to be talking about testing? And the elephant rider thing, which came from a chap called Jonathan Haight, who is an American psychologist. He used to be, I think he was at Oxford. He was a professor at Oxford. He wrote a book called The Happiness Hypothesis which has got this parable of the elephant and the rider which talks about this idea that people's hearts basically are their elephant, the heart that drives everything, drives emotions and everything else and their head is the rider and the rider is there basically to try to do what the heart wants it to do. find meaning in what the heart wants to do. there's like a total conflict going on all the time between your heart and your head and it relates to the elephant and the rider really well. The reason I came across that they spoke the happiness hypothesis is not because I went out and researched it, it was because I was sitting and watching GB News at 11 o'clock one night when the comedians were on and one of the comedians on GB News was talking about this happiness hypothesis and making big fun out of it. And I thought, I'm going to go away and read that. I went away read that and I thought, you know what? I can relate that to the whole AI idea about what I'm thinking about, about emotion and about how we're going to get to a point where AI can have that emotional tendency, looking at context, looking at morals and all of those sorts of things. So the trigger in all of this, comes from everywhere. I could listen to somebody talking about something completely different. And for some reason it resonates in what I'm thinking about. I've always been able, I don't know why, but I've always been able to do that. I've always been able to sort of look at something from a slightly different angle and think, do you know what that fits? It's like when I was at Electronic Arts, the next company down the road to us that had a little place was McLaren F1. In Guildford they've got this great big centre. And I found talking to the people at McLaren really interesting on how they test Formula One cars. Wondering whether there's ways that I could bring that into testing video games. Now, a lot of it doesn't fit, but sometimes you get some little nuggets that come out that are completely new. I can remember years and years and years ago when we were talking about in testing about priorities and stuff and I started thinking about the medical, my mum was a nurse. But I started to think about the way that they do it in hospitals and stuff and started talking about the idea of triage. Started talking about how we could bring the concept of triage into testing. there's loads of things going on out there. And the good thing about testing is that it involves everything. It involves everything that we're doing. Every step that we take in the world right now involves a test. The next step we take, do we put our hand in the bath without making sure it's not too hot? Geoff: Mm-hmm. Chris Ambler: You know, all of these things, we're making those tests, those decisions all the time as we're moving forward. And so from a trigger perspective, I think there isn't a trigger. There is hundreds and hundreds of thousands of triggers, yeah. Geoff: Just a lot of things. Yeah. Yeah. Yeah. And that Peter: It's a Geoff: makes sense. It certainly if we reverse, if we reverse back into Eurostar, it was interesting because we started that day, the day that you spoke with the lady from Microsoft who was basically telling us as an audience that if we were clever enough, there's always going to be a job for us because I will bring more, more, more significant problems to solve. And they'll solve all the easy ones to do, which sort of set the scope. for talking just about using AI and testing with AI. But actually, I think you've got a really big audience because yours was different. And I think that what you were just explaining there reflects that in that you were thinking differently about the same problem effectively. how do you think, I mean, from your point of view, what sort of response did you get from those people? And give us a bit of a flavor to your theory around the theories you were telling us all around. Chris Ambler: Okay. Geoff: the world of psychology and AI and testing and AI that was the other thing wasn't it most of the conversations were all around using AI to test very Chris Ambler: Yeah. Geoff: few people were talking about testing AI you were one of the few that stood up and explained something around testing AI so yeah give us a give us your perspective on on what you were talking about there because i think it's really there were some really important key points in there about morals and ethics and everything that i think we all need to be thinking about if we're testing, but specifically in AI. Chris Ambler: Yeah, I think the main message that I was trying to put across, the title which was sort of like, is psychology, the next testing skill, was really down to the fact that when I started to look at ALI properly, from a testing perspective because I'm not just looking at it from a testing perspective I'm looking at it from a development perspective, from a commercial perspective and all of those things as well. This was a testing conference, this was talking and that is my background anyway. But the major thing for me was that as testers we're going to have to stop testing outcomes and start testing behaviours. That to me was the key message because if you look at the traditional way of testing that we've always done we've always had this scenario where We write some scripts, we come up with an expected result, we test the system against the script. If it comes up with the same expected result, then the test passes and everybody is happy. The problem, the sort of simple equation that you can use for that is that our traditional testing is A plus B equals C, right? So if you get, if A is the... is the test, B is the result, you get C and C is okay, that's it. If C is right, then the test passes. The problem with AI is because we've got this, what started off as the big data scenario, which was when we create outputs, so when we create data outputs, those data outputs now get wrapped back into the AI system. So in theory what you end up with is every C that comes out then gets multiplied by A. So you end up with a new A. So what you end up with is A plus B equals C and then the next time you run it it's C times A plus B equals a new C. So what you in theory... I know I need to shake your head. I shall explain what I mean. Every time if you put that into a real situation what you find in AI is that every time AI makes a decision or computes a decision let's say that decision becomes part of the the training data that gets fed back in again so the so the c times a is the drift of the training data so if you've got one test you could run it once but the next time you run it the expected result as which has remained the same as far as you're concerned might not match the actual result anymore Now, do you automatically then fail it? Do you say your test is wrong? Or do you look at the actual, the new actual result and say, well, actually from a behavioural point of view, that's still right. It's it's just different. And is it acceptable the way it is? Right? So if, if, if, if, The answer is 5.5. So if you look at it from a purely old fashioned linear testing route, 5.5 would be wrong because it doesn't match the expected result anymore. In AI, the 5.5 might be within the parameters of what you could use. So it becomes more of a behavioral thing rather than an outcome. So as testers, we have to think about testing outcomes, right? So that was the, if you like. my initial focus with all of this. But then I wanted to try and put across why psychology is important in doing this. And then it sort of got into the looking at the way that the world worked. And one of the early things that I thought about is we're not going to be able to figure out how we're going to test AI systems. and test their decision making capabilities and their ethical and moral capabilities if we don't actually understand how we do it ourselves. Which is why I started looking at the human process for decision making which is basically what the books are about. It's starting to look at things like as an example if you look at India, India is a very, very socio-centric country, right? A socio-centric country is basically where the group is more important than the individual. But if you look at the US, the US is an individualistic country, which means that the individual is more important than the group. Now straight away, if you think about how we make decisions as humans, We understand that, we understand well, they think like this, they think like this. So we have to be different, we have to approach things in a slightly different way. And that's where I'm using... empirical experimentation in the book about things like the trolley problem the Philippa foot from the 1967 the trolley problem where you've got a choice of you've got a runaway Geoff: That's it. Chris Ambler: yeah I won't go into the detail of it right now if you want to understand what it is by the book but the trolley problem also the Heinz dilemma There's a number of really well explained human decision making ethical type of experiments that are out there. So I've used those to try and understand how we as humans make decisions because it's like everything else until we know how we do it ourselves. We can't automate it. We can't create the right things to automate Geoff: Yeah, no, no, no, no, no, no, no, no, Chris Ambler: it. And what I actually figured out is, you know what? I don't think we really know how we do it. That was the key part of this. So I'm sitting here now and thinking, well, if we don't know how to do it, how the hell are we going to get to a point where we can teach AI how to do it? How are we going to emulate or simulate that in AI? I think from a tester perspective, we need to understand these concepts. We need to understand the concepts of bias. We need to understand the ideas of data drift. We need to understand the butterfly effect. We need to understand nudge theory. All of these things are really, really important things that we have to live with every day. So unless we're actually going to say, well, we've got two choices in my opinion. We can either say... We're going to create AI in a complete mirror of ourselves. In other words, we'll leave all the bias and all the rubbish that's in there and we'll just let AI carry that on. AI will do it much more efficiently than us. They'll just end up killing us all in the end because it'll just create arguments and fights for the rest of our lives. Or we can say, right, we'll create this new vanilla world where there's no bias and there's no conflict and everybody, you know... everybody understands the ideas of nudge theory and we've got it all under control and the butterfly effect will be controlled. All of those things. But what that will also do is that that will kill creativity, it will kill critical thinking, it will kill all of those things. And then you'll get to a scenario like a, I heard a professor, I can't remember even which university it was, but some professor that actually said, eventually we will be to AI like our pets are to us right now. We'll just be nonsense, we'll just be nice to haves, you know, every good AI system should have a couple of humans as a pet. Now all right, that's a very dystopian, over the top view. And I doubt if it'd ever get that bad. But as a concept, I think it explains the scenario. So what I was trying to do in the talk was get those ideas across that as a tester. we need to be considering those when we're creating the ways that we're going to test these behaviors, not test the outcomes, but test the behaviors. Now, was two, interestingly, there was two things. One, I think I stood up in front of those people and I've been doing, I've been presenting at conferences for God knows how many years now. And the first thing I looked at was my god, this is a big subject. There was a lot of stuff there and I started off thinking, is this too much? Is this too much to be putting in front of a bunch of people? that haven't really thought about this before. You know it's like saying, well I can put a drop of water on your forehead to give you an idea where it's like to get wet or I could chuck a bucket of water at you to give you an idea where it's like to get wet. There's a different response each time. And after I've done the talk, I actually, I got a lot of feedback from people, a lot of people were coming up and talking to me about this. Some people were saying, I just don't think anything is going to change. think as testers we'll just keep doing what we're doing forever. And that to me just reminded me of... this idea of people that bury their heads a little bit and sort of say I don't want my life to change I'm happy with it the way it is. But then there was another bunch of people that said well no we're just going to use AI to test systems and for me I'm not even sure that works properly. I I've talked to so many people who say, we use AI to write our tests. Geoff: Yeah, no, exactly. It's not as grounded. Chris Ambler: It don't work because at end of the day you can have an AI system that will write you 10,000 tests but 9,644 of them will be total rubbish because you haven't prescribed them properly plus the fact Geoff: Mm-hmm. Chris Ambler: it's going to take you three years to actually go through and review them all to make sure that they're actually right so if you're not a good prescriber and you're not a good reviewer then they're two tasks that you do as a tester anyway when you're creating test scripts all you're actually doing is getting AI to write the words for you They're not going to speed you up, it's going to slow you down. Anyway, there was that sort of people. There was other people that said, you know what, you're really right, I just don't think I'll have a job in a year. For the same reasons really, think AI is going to take over everything. But the last group, which was the interesting group, were the people that came along and said, do you know what? I've never really thought about it like that. But some of those things really make sense. So I felt better after I'd spoken to those types of people because I thought maybe it wasn't too much too quick. That was my sort of internal thought of it. But the interesting thing was, and then later on in the conference, later on the next day, I ended up doing a lightning talk. The lightning talk that I did, and it all came about because when I arrived at the conference, I was asked would I like to do a lightning talk on this particular day. They were gonna pick four or five people to do four minute talks. Would I be interested in doing one if I get selected? And I just automatically said yes, because if somebody asked me to talk about something, I'll talk about something. I love doing it. Peter: Yeah. Chris Ambler: But I've not really given any thought to what it was I was going to talk about. And interestingly, I didn't give it any more thought after that. They'd said to me, so what are you going to talk about? So I went, I'll talk about, are ethics ethical? I didn't even realise what, at the time, didn't even think about what that might even mean. it just, came, was one of those coming into my head things. And so I went away and forgot about it because I thought I won't get selected because I'm doing one of the main presentations. They won't pick me, they'll pick people I want doing these things. Lo and behold, the evening before I get this email saying, congratulations, you've been selected to do this talk. So I thought, right, I'm going to have to figure out what it is I'm going to say. So I stood up on the stage that morning in the big hall and talked about ethics being ethical for four minutes. And somebody came to me afterwards and said, do you know what? You've just stood up at a testing conference. and spoken for four minutes without mentioning the word testing once. But everything I'd said was related to testing. So again, that gave me this idea that my message maybe was getting across, that this whole idea of psychology being an important factor in what it is that we're doing. But then when it sort of happened. after the conference and then again, you'll know that you go to these places and every time you go where you find 15 people that come up to you afterwards and say, we need to talk, we need to talk. And they've got all loads of other ideas. So I then start getting all these people coming along that started to, I talk about data drift, they start to drift the topic into lots and lots of different areas. And I then got talking to people about the idea of sovereign AI and how we're actually going to create revenue and create wealth out of AI. And I started thinking about data sovereignty and thinking about how we could make sure that we could still monetize the way that AI works. So again, I studied it. And my next book, just to give this a quick plug now, my next book which I'm looking at pretty soon, I'm hoping within the next few weeks, is going to be called Sovereign AI, the Dynamics of Ethical Data Governance. So it's basically looking at the whole idea of sovereign data, how that's going to work. And I've got some ideas about using the phrase data is the new oil all of that sort of stuff now the interesting thing for that that i've learned from my last book is that doing it through publishers is very slow you know to actually get through the publishing process so i'm going to self-publish this book through amazon It's about 60, 70 pages. It'll be dead cheap. It'll be one of those things. And I can get that out very, very quickly because what I'm finding is that the ideas that are happening around here are happening so fast. Geoff: three files. Chris Ambler: By the time you get your published book out there, you know, the big publishers... The idea is gone, it's finished. These have to be done. So my plan now is to start this program of these short, snappy, very, quick thought books rather than anything else that people can buy for seven quid or whatever currency you want to work at or something. That would be just like buying a sort of look at it from an app. a mobile app game type of things where you can go out, not spend much money, read it and then you want to chuck it away. get the concepts across there. so now I'm going into knowledge mode. I want to try and think about these things, get stuff out there, get people talking about these things, which is all gonna help with the organization that we're currently setting up, which is, it's gonna be called the Responsible AI Certification Council, which we're looking at being able to certify. Basically these new things that we're calling responsible AI architects who are going to be able to go into organizations and basically do all this stuff that I'm talking about, understand the psychology, understand the technology, understand all of those other things. So that's like phase two of my retirement mission, if you like. Geoff: Thank Chris Ambler: I'm not ready to stop yet. Geoff: No but unfortunately I think we have to stop today. Peter: Very good. Ver very good. Yes. Chris Ambler: Absolutely, absolutely, Geoff: Peter you've not said a word mate. Peter: I know, it's it's been an absolute pleasure listening to Chris ramble on. do you Geoff: It's been superb, actually. Yeah. Peter: know what's what's the one underlying thought and and I appreciate everybody's coffee is going cold right now or they finished it about twenty minutes ago. But the underlying thought I got out of this is the same thing we've always talked about, which is testing does it change, you know, or or does it stay the same? Is it just how we do it that gets different? Because some of what Chris was talking about to me is risk based decisions. What's the risk? 'Cause the the analogy of putting your hand in the bath, right? You could take the risk of getting straight in and and burning your nuts off or whatever you wanna whatever phrase you want to use, or you test it first with your hand. It just depends on your risk appetite. And AI can't decide your risk appetite for you. Only you Chris Ambler: Absolutely. Peter: only you can do that. And and so the other fascinating thing I picked up on is I think God we're probably all too similar so so we'll we'll have to get a a contrary point of view in here. It's the we've got to evolve. It if we don't evolve as as as an industry, if we don't evolve as human beings within that industry, and if people of our age and generation do not champion the evo the evolving, then everything will go to hell in a hand cut. Because there's too many people around who you've described who say, Well, this won't make any difference, AI won't take my job, all that and and the answer is it won't, unless you put your head in the sand and think it's not going to impact you. If you take the positive mindset and the growth mindset towards it all and say, This is gonna make me a better person, a better tester, a better thing, and and help me solve more complex problems than I ever dreamed I could think of, then then gosh the world's your oyster. and Chris you mentioned about having a spare copy of the book. Jeff will furnish you with my address and if you could s put one in the post to be signed Chris Ambler: Ha ha. Peter: and autographed that I would I would very much appreciate it. a Geoff: He's a collector Chris, he's definitely a collector. Not quite as big a collector as me but he's doing well. Peter: Yes. No. But but Chris, absolute pleasure. we'll have you back on as soon as you've got that seventy page book written up and available on Amazon to for us to plug. but fascinating talking to you. I've now spoke spoken longer than I probably should have. Jeff, do you wanna wrap this up and Geoff: I only very very quickly because we are running late so Chris I absolutely appreciate your time today the subject we've picked on is immense and we've managed to cover a hell of a lot of ground in half an hour a lot more to go so maybe we we can because I wanted to pick up on what the UK government are now doing because I noticed there's lots of noise in the press and on Facebook yesterday around the area that you referring to the governance side of things but I haven't got time today I it'd be worth coming back another day but thank you I really genuinely appreciate you and it's great to see you again. was only a few weeks ago I saw you last so it's really good to catch up. Peter: Yeah. And if you're hiring overseas Chris Ambler: you Peter: consultants for the AI Council, I'll send you my C V Chris Ambler: We are, so I will. Geoff: Yeah, getting there. Peter: Very good. Geoff: Peter is still working. He's the one on this that's still working. Peter: I'm the only one old enough to retire who's still working, right? Chris Ambler: you Peter: Chris, thank you very much for your time. Everybody, I hope you've enjoyed Chris Ambler: I'm f- yeah. Peter: this podcast and we'll definitely be hearing more of Chris later on in the series. Thanks everybody. Chris Ambler: Thank you.