How Portal Can Change Your Security Forever

sorry try fun and exciting things ok so when I get to go I'll start sounds like I got to go yet I got to go ok lets me set my little timer here just because I don't really want to ok so does anyone here not not here to talk about video games nope I see you my name is uh Katrina rods and or Katie a more informally and what I'm going to talk to you about it's called how portal can change your security forever but in the course of making this talk it expanded into much more it's literally how video games can be used to change whatever behavior one this can be everything from changing security so things like

training really applying this type of techniques to training programs whatever this might be this can be how to create a good team things you do to keep your team engaged keep them challenged and keep them constantly doing good work as well as let's say that you have your own personal thing you could be a bug bounty hunter and you want to know how to employ such things that you see in games to keep yourself going to keep yourself challenged this is this is all about that so really expanded into more than just portal and just security specifically the idea of awareness but I should be fine throughout the course of this talk I don't know if any of you

guys saw on twitter I'll be sent me there's a whole bunch of different games and I'll ask you questions and there may or may not be like a steam gift card or something okay he's excited and he's the only one that's excited then he's going to get it automatically what if you were you what is your name Aramus is going to get it unless you guys get excited so get ready for excitement theme thanks pretty excited any game sitting in cool well we'll see how this goes so what are we going to talk about um games and gamification I know it's a very common misconception that gamification is a buzz words anyone not familiar with the

word gamification did anyone just walk out of a cave nope okay good gamification is used so much it's a massive buzzword you pretty much can just throw it out there people I guess I'm excited and a lot of people have seen it applied and starting to get a bad rap because a lot of people just use a batch great it's like a badge on or I made it look like a game but gamification actually goes much farther than that because it employs amazing behavioral theory to get what a game is and it's the idea of taking the rules and the techniques and the strategy behind making a good video game or making a good game and applying it in

outside of a video game outside of a voluntary action and a lot of this one we're going to focus on there's a whole bunch of things involved there's motivation there's a wide variety of things but what we're going to focus on today is the idea of a learning curve which is this it's a learning curve there's entire people that spend their decades of a career looking at that curve so just absorb it for all it is three fun but so we're going to talk about the learning curve and specifically what it is how a game fits on it where the optimal area is for it and then more importantly how you manipulate it because that's what a

video game does it is created to manipulate this curve aren't you excited yes oh yeah there it is yes the competition anyone want this gameis light that's a board game guides come on Quixote it's a board game it's not let's go old I'll start telling you about it um so this game pretty cool game this is actually one of the first screens on it you're in kind of like a waiting room and this is one of the first maps that you see so every journey is a series of choices the first is to begin the journey you can understand why I put this here hopefully you see what I did there you see what I did um so and what

this game does it's called antechamber it's kind of interesting because it's very simple in nature it you're navigating around a which I can show you you are navigating around a room so I didn't not if I am I gonna do that let's see if it works I might have totally screwed this up no okay let's go back nevermind um so you're navigating around a world in this world hmm so anyway you're navigating around this world and this happens to be a map that you look about and it's literally going backwards and forwards and there's a whole bunch of prompts like this up to give you kind of hints at to what you need to do if

you just look at the game if you're used to really visually stimulating games it's not at all a lot of its black and white with a few colors in there to give accent but strangely enough as you keep playing you realize it's artistic creativity and the complexity involved it's about solving a whole bunch of puzzles I'm it is available on Steam but what it what it does is it really once you kind of get into the game and you've understood it you really do need to have a good understanding of it because sometimes the way you get through it is you you walk forward and then you turn around and you look back again and it's

totally different and if you're not used to the understanding of the game and if it didn't have a good gamification technique and good behavioral strategy that was employed you would quit immediately cuz you like what are you doing going forward like you just literally going in circles until you accidentally turned around and went oh this is different so it's an interesting game i'll show you a little bit more about it but that was first opportunity to get a gift card but we'll do a couple of more of them may be fun so anyway video games and a learning curve in order to understand this we need to go over the learning curve so this curve which is very

exciting i was i was informed it sideways it looks like something else how do you think about it anyway so the learning curve what it does is extremely simple it basically says over time and in the term of a game that can be experienced maybe not necessarily just time it could be amount of time with a game you develop a skill so much so that as time goes on skill acquisition goes up and some things to notice about this is that down here this is where time is going by and you're not seeing much progress vs suddenly we have we have skill acquisition in the top is when we finally have look I've acquired this if

you hang out down here too much if this gets elongated towards us a lot of time no progress it's too hard and this happens they're like nope and all of us Sark souls what I mean I mean think about it think of a task it could be a game think of any sort of game that you've shown up in it are you get into a level to where you spend a lot of time putting a time and experience and effort and you see very little progress given examples Dark Souls anything else these are excellent aim anything else what about in training and your job hey I got some nods nobody's in this really bold enough trying to get a promotion there

you go so you have there's a whole bunch of situations in which case if you spend too much time seeing not a lot of progress this ends up happening nope I'm out done you don't want to live there video game that lives there is something like mist never missed and that's more than it great would you just drop in you're like so what do I do do I poke like do it would but it is over here and you spend a lot of time with no progress the other one that happens is this if you like so you get great let's get them to the top but if there salute like if you live up there and

you've acquired the skill you are totally proficient this happens well that's fun exciting now with this one can you think of any training examples where you're just super bored most of them what are you talking about any weight but this is that idea that you are above is for a skill acquisition maybe you were given something to teach you something you already knew so you had to sit here and you had to spend time on something you already know this happens with tasks if you approach a game sometimes games are like this as well there's a lot of games for example I mean maybe you like Frogger I don't know but maybe you've already acquired

that skill and therefore this becomes boring for you if a video game or a task or anything lives too far on these two extremes you will lose your audience you will lose your users you will lose everybody so the big thing with a video game is to live in that middle to really make sure that you live in that curve so failing to succeed does not mean failing to progress this is more stuff from antechamber so there's types of games and they utilize the learning curve in a different way so you have linear game linear play games where there's a very clear beginning and then and you're going towards an end level 1 level 2

level 3 before we have Zelda I love ro been angry birds candy crush I'm gonna give i can tell you theoretically why this happens i couldn't actually tell you through a ton of experience so my jam um and then what is this i don't know you tell me oh well i left it in there is the cutest instruction it's right behind you sir you I I did tail so you sir come up to me out gusta steam gift card for you so come I need will need the ad the email address after you let me know so anyway yes portal 2 and these are linear games and that you start with level 1 you go through and

what ends up happening for these is that your learning curve and the game modifying to it lives within these levels so you have to stay within the sweet spot for level 1 level 2 level 3 which means that if you get to a good level of proficiency if you're in the sweet spot in level five for example and you come back to level one you're in a row you're in a bad spot you're in the I'm too good at this on board which is why you have few games that unless you have some other motivator like playing with a child or playing with a friend or something like that you're not going to go back and do this again because you've

got this covered it's too easy for you so you have to have something else to keep you coming back so that's why things sorry thank you so it's it's this idea that it is a linear a linear pattern and this learning curve lives within each one of those levels and you get through it to the end this is something this is a very similar pattern for training usually when you're trained on something great we're going to say this is level one and we're going to get you through it and though and then all of a sudden its annual training time again and we're back here and is it exciting do you like it no the game is

exactly what needs to happen in even if you have a behavior that you want to see in anything whether it's yourself or in a group that you work with you have to the game has to work with you have to if you want them to play it again the next time they make another game you need to make sure that you grow with them the other type of game you have a nonlinear gameplay anyone like dota that guy does evil geniuses parently as the crew favorite games bottom right we'll go on so what we have here with the non linear game is with things like dota I got even here where was this one Wow Wow

and then we got halo 2 yes still owns it so with these you can play the same level over and over again but what's happening is so it's not necessarily a linear fashion you can be in the same environment over and over again but what's happening is with that learning curve things like opponents tool skills and teammates are what keep you in that sweet spot you get team members and you grow together to be better you have opponents you are matched like in dota so mr. Haddix over here is a friend of mine and he's kind of a dota player a little bit and he has given me my little crash course in it and I watched some of

the the international so what they're calling it ti 2015 apparently so I got to watch that last night you're all very impressed so you get mad which is but it's really cool to see because you have your team and you have your skill level and you are matched appropriately with opponents that have a similar skill level and that's where you stay within hear things like when the idea of playing campaigns for things like halo when you matched yourself that was a big danger because you could match yourself with a whole bunch of like suddenly the super expert could come into your game and completely annihilate you and it was really upsetting or you could go a hang

out the whole bunch of noobs not as much fun so with games now they're really focusing on trying to match opponents and teammates together to make sure that happens and then also giving you skills and tools in your environment which we'll go over a little bit more on how you manipulate these to make the task more difficult or less difficult and live within here this occurs in security and in behavior in general what we're seeing a lot of is things like CTFs where it's at constant repeated interaction and we're trying to create an environment we're trying to create a team we're trying to pair trying to get tools to create engagement and create your behavior this also we're starting

to see this across different types of companies and again we'll go over to this a little bit more different types of companies creating teams and in circulating them being like you don't always get to work on the same project with each other I know that sometimes that can be kind of a bummer in the moment really go I've got my friends like got my comfort zone I do this thing but switching it up like that really helps to increase that engagement and really helps to keep people within that zone but we'll talk about it a little bit more so with that we have different types of learning curves this one happens to be a steep learning curve

which simply means you spend some time and then suddenly you've got it it's not a slow progression you spend a short shorter period of time but you might have some more some more time where you don't see as much progress and therefore people call this difficult you suddenly like I don't see progress i don't see progress and then you have it and now you're a lot more proficient and you you see your skill level wise significantly what are some thinking on games what are some examples of games that you think no wrong answers could be a steep learning curve for difficult what cue up ok so a first-person shooter ok anything else minecraft once you learn you could get

muscle memory the whole bunch anything else you get in the back there try to hide for me I can walk I'm not tied to this I'm in heels but I can walk it's the talent yeah a lot of controls for example ok I've heard kerbal and I've heard curb all so don't don't shoot me um the Kerbal space program I hear it's an extreme learning curve and a big part of it is like you're saying it's the buttons you have to figure out these buttons and how to coordinate with them and once you do once you've figured out how to play this game you suddenly oh great I've got it and then you have what

is this league of legends this is this is dota and then what's up here hey absolutely so these are all games that I actually so first I found these ones and then I went to just see if the internet agreed with me and all three of these were considered top five stupas learning curve games but worse it's steep learning curve and worth it which is a big part of it I'm you need to make sure that what you're doing is worth it in your everyday life you will encounter things that have a steep learning curve and we will eventually talk about how to make this deep learning or learning curve worth it that's how we'll end up manipulating so

with a shallow this is a shower learning curve and it kind of get it and the idea that over time you see skill progression but it's slower so you're going to see progression see skill acquisition quicker but it's going to take longer to get that skill what kind of stuff do you think what kind of games would be this way legend zelda 2 stars i'm really excited do you say chess sweet chest yeah jess is good what else flappy bird what else because holds your said stuff who's kind of Dark Souls good this guy stuff Mario Kart through smash brothers Angry Birds shallow learning curve where you seeing progress relatively quickly but it takes some time to get through it

sometimes the progress is so slow so you don't realize you've acquired the skill until you go back and try to do something that's at a lower skill level than you are ah and you're like oh I got really good at this this is winning yeah it's a perfect example in real life so this occurs a lot in a lot of management techniques will take this and try to effectively slowly acquired a skill up really just it's an you see a lot of progress you can reward along the way it's not as frustrating and then suddenly you're like good job you Street Fighter screamin you have acquired this girl good job movie on so shallow learning curve is one of the other ones

what's this super hack that's the gun it's a trippy game I want to show you the video if I have time later I well yeah you have to what you have to do is this little this little triangle here you have to make sure doesn't hit anything which means you have to move it around to where it's in it's gonna to the appropriate thing but anyway how do you think well my goodness I'm as much with it what is this dole denies this is steeper shallow learning curve in your opinion shallow yeah Michelle a learning curve Sloane slow and steady I dig I dug the karate chop okay the final thing I want to talk about about a learning

curve is the idea of intellectual complexity and this is probably where a lot of you will be like I do understand her I don't understand because it probably falls within something that you're not used to so time Dillards things like candy crush this is a very low level of intellectual complexity okay not saying that you're dumb if you play the game so just let's just say that right now somebody outside you kind of are but I did not say that so we have candy crush it's a time filler and what and what I mean by time filler it means that you literally can pull it up on your phone when you have five seconds but nothing dies in the game if you stop

at all there's no real ramification for you pausing it's just can I do this for a second you can even be half listening to the person that's talking to you I get gotten a lot of trouble to a time fillers are you listening to me yeah I am Oh mean oh oh can you get go what do you do but time fillers it's a low level of intellectual complexity there's not a l'anima ratifications it's just it's really surface level the levels are usually pretty short I'm going to require a lot of time complete immersion things like dota you have to spend at least 30 minutes in a level because if you stop your person is going to die in

the attack and then your team will suffer you have to be willing to sit there and a 10 and my attendants not just like a sweet i got it like this great I got this you have to be paying attention to your teacher your stats your team stats the other team you need to know what's going on different things like when things regenerate where things happen how much gold what's our strategy it is a complete immersion and it requires a lot of intellectual complexity and a lot of an election time also other games like these hasn't created yeah yes we will get into that so then you sassin screed that things like where you have a gray

area you're right and it's it's like the middle it's absolutely addicting all these can be massively addicting but then you have a gray area in the middle where it's not maybe don't necessarily require 30 minutes 30 to 60 minutes at a time but it's not a time filler so things like portal and portal 2 yes it requires some time for you to sit there but you couldn't stop up in a middle of level and be like okay just wait a second or you can be like okay you need something for me got it it it doesn't require as much time but it still does require attention and they're all equally as addicting depending on who

you are so relating this back to tasks that we see let's go back to the idea of training have you ever seen training think about if I commanded your complete immersion I need you to sit there for 45 minutes and pay attention to what I'm looking at what I want you to look at but the behavioral strategy is this how would you like if I said sit down and play candy crush for 45 minutes nothing you have to do you have to pay attention because I'm gonna asking questions in the middle of it how'd you feel about it you guys are all very excited yeah so I should discuss to make some training that is a very very common mistake that

you see in training or in just general tasks where you're demanding complete immersion but whether it be through intellectual complexity a sophistication skill level whatever it might be you do not properly understand your audience you have asked them for that and required that usually by demand of their job or a team team coercion but you designed this and that's where a lot of things falter so you have to understand really when you're trying to change behavior and trying to use gamification you have to understand your audience you need to know the behaviors that you want to change so I want to do this one particular behavior behavior and you need to know where it falls on this

curve am i dealing with complete immersion great that means the coast complete immersion games they were I mean they get some good some good following it's hard to make them because they're not just sit and we're good things like candy curses it'll just make them and they just go they seem to make more levels it's not a moral of thing there's a lot of love that's put into this game it's it really is a matter of about eighty percent of your games and eighty percent of your behaviors are going to fall with the knees to that you see in everyday life it's the idea of a time filler or a gray area it's just a

different strategy you have very few video game companies that are here here and here like dota what what sorry Jason Jason is going to get pointed out what other games to start to make the company to make stottah self Timmy portal okay so thats actually goes in the greater so they jump over which is off to make half-life Counter Strike Team Fortress that's a lot of here which is very interesting because that means that they focus here but again portal is a gray area but they have their complete immersion with dota [Music] absolutely so you just pointed out the idea that you probably made they probably made more money with portal and the reason for it is that you have far

more people that live here than there you have a lower attrition rate with this because once you can get people in a complete immersion state that's where they're going to stay forever how long have you played dota 10 years that's a long time this is Marquette so I complete immersion when you have a complete immersion behaviors that is a fully ingrained it's intrinsically motivating it's something that you put forth a lot of effort in and it's hard to kick it to be perfectly honest it's similar to a behaviorally speaking it's similar to a drug addiction all the comp components that are involved it's hard to kick because it's because of all the things you put into it it's good but

it's to be quite like it's amazing to see it in action like part of the reason I was really enjoying watching this dota tournament is because you can see all the components coming together to be like oh my gosh this is really complicated and there's no joke once you actually acquire this skill you would not stop because you have to you have intellectual you have intrinsic by in which if you can get intrinsic buying on any sort of task then that's amazing think of some of the stuff you do personally on your own how many of you love your job oh let's kick it okay you're gonna love your job do you love it because of the money or do you love

it because of what you're doing because it's done notice it's fun um that is an intrinsic motivator so how like so if the things get tough at work is it a little easier to get through because it's fun you have a hard time a little bit so guys get some some head nods and that's what an intrinsic motivation which is where complete immersion comes into place these are behaviors that are very much ingrained in intrinsic motivation if you can get a behavior whether it's personal on your team tied to an intrinsic motivator it's fun it's morally satisfying it makes me feel safe whatever it might be those things are hard to kick just because it's in trim

they get it there but there you good no extrinsic motivators are much are much easier to kick those are different sorry [Music]

almost identical oh yeah it's a it's a it's a slight spin off I've been told that it's back to the steep in the shallow dota has an extremely steep learning curve so there's an answer league of legends they have flattened out the learning curve a little bit more to make it more popular for more people to be like to will acquire it because because dota can be quite challenging and you spend the you can spend a lot of time just getting hammered and seeing no progress whereas league of legends has flattened it out a little bit they've manipulated that learning curve to make more money which is way works so with this with a shallow curve this deep

learning curve I shall of learning curve do you think which one of these three do you think it is more suited to well if you were a game company you said I can only pick one which one's the time filler okay the shallow anyone else have anything else but because ahead the ad-supported sir genius yeah depends on the content difficulty you know what I've heard of it I've never played it no I don't have an iphone anyway so what you guys are pointing out is adult yes getting rush what the company that makes it was doing is better than anybody else was putting in a variable learning curves then you go several levels of making progress the

steam wall where you have to basically do a micropayment spend two dollars to get nothing so that they definitely do that for sure that on ICU it's going to take me a second thank you that I've been the person it's like oh it's like I got you um so you're absolutely right there several things employed there in to make money for the people that actually get money from it there is there's like there's a shallow learning curve and then suddenly they do a bump a small bump in a relatively shallow learning curve two and then they've also set up your lives as a limited resource which is also something else if I go hey you don't have as many of them like wait

a minute I want more but then also saying I can get you past the small little bump with this and in the very very beginning they make that that thump really hard very very hard in the first couple worlds and then after that it's actually relatively easy because you've been trained as think I got to this spot it's hard let's buy my way out of it but there's and there's a whole bunch of problems with that but as far as making money yeah that works right but it's also a way that they lose a lot of people to you you see people drop off at certain levels because they get to that spot and like I'm not paying to get out

of this and I spend too much time finding it difficult so I'm done yes hi how's resource yeah carry over yes better resources as useful long and things like candy crush you carry nothing so it's if I understand how to correctly you actually don't carry your resources long no so wait so how does resource carryover it's a very good question um that creates two different types of motivators if your resource carry on goes like say for example Diablo where you go through your like look at my cool outfit it's not an outfit I know I played I play diablo I was I was in it so anyway with with with that that that what you've done with

that is that you've you've started to take that carrier of a resource and you use it as a badge it suddenly becomes this badge to wear you will you'll start going and doing all the things just to get resources to show hey look here I am that does help with getting farther you can still have a steeper a shallow learning curve but it actually gets back to a motivator where you start making this thing your helmet is now a extrinsic representation of an intrinsic motivator look how cool I am unfortunately though when you do that it's extremely effective when it comes to changing behaviors as well some of the most effective things I've seen is

are taking little characters and turning them into physical embodiment I have this character sweet that means this about me but if you have ones that don't the resource carryover does doesn't happen then it becomes again more about you're seeing that more and more now because then it becomes very much about KU am i up against that's the resource that carries over who do i play against rather than look at how much gold do i have its i played that guy oh I know exactly what that means so it's become a much more simpler system but yeah that's it really just depends it can live across these two usually you have resource carryover it's not going to have as much here

because again it can be because there's so many levels on these things it it just becomes nothing you're like oh great I've got eight thousand things of gold what wonderful so you don't have resource carry over here as much versus some of the complete immersion you do because that's part of the world you spend so much time getting it yes I have okay come get quests yeah yeah yeah is it game question works yeah yeah um so you can you can do similar things where as you go through there are organizations that are employing things like a ranking system they are employing things like badges where if I did this thing and the resources carry over and you completed

certain things and done effectively those badges then turn into great you have these four badges and those are required in order for you to get a promotion or for you to be able to move teams or for you to be able to request this thing and get other resources but the is very very sticky slope because if you are a very very slippery slope it's sticky thing to do because if you um yeah it's it's home because if you do it incorrectly you can kill it all but we remember how you talk more about later so manipulating the curve we're going to talk about now is starting the game I have I haven't I've an hour right great

yeah what's up so starting the game manipulating the curve starts from the very very beginning anyone know what this game is what ya brain that guy ok will you get another exciting this is great can you tell can you kind of give a small a small synopsis of what grade is do you want tell you want to say what braid is you know like a few short sentences generally game it's a puzzle game yeah kind of thing do you think it's linear linear can alter time yes yeah it's a cool thing about Alison thought it was I thought the art behind it was really awesome but the cool mechanic behind braided this idea of tim

is often a search to rescue the princess she has been snatched by a horrible and evil monster this happened because Tim had made a mistake I'm sorry gonna destroy this for you Tim and the princess were actually in a relationship and he made a mistake and this is all about him going back and trying to fix this in time so one of the big components with this is the use you don't ever I mean you die all throughout it but all you have to do is whine time but it's very it's a very interesting game I with it though is that in the very beginning it's a great example of this idea of creating foundational skills as

you this is part of the first level hit spacebar what did that do a jump or I just got to this wonderful little ledge push the UP button and the reason I show these is because when you first start a game when you're creating those foundational skills you have to give an indication of what to do let's go back to miss when you're how many of you played missed okay simply missed when you first show up in the world what did you do just click on where that this is a bad I don't know what is it that I don't even know what this is I mean there was also times where I was dif tinkly play I was playing with

something and I'm sure it did something didn't do anything just moved in do anything at all and the problem with mist was that you have no indication of what to do you were just randomly clicking buttons great games nowadays what they do in that first level that's usually super simple is they create foundational knowledge as you go through they say stuff like clue here do it click right here after you've done that once it goes away or you get to a new obstacle yep what are you doing this this is also part of antechamber and these really helped to create this kind of concept of a foundational skill to zune with this game is huh it's actually

pretty cool it's called dark echo and what you do is you have to walk around and all you have is literally in the dark and all you have is the sound of your own steps bouncing off the walls to tell you where you go and this is one of the first one of the first parts of it were basically says find an exit and use noises to locate it you're just throws not coal turning in circles so what you do is you're just walking through and figuring it out I mean if you didn't have these indicators you'd have no idea what to do this same thing applies and it is a very common mistake in any sort

of behavior what it does is it indicates in everything we do onboarding is crucial even for most complex of tasks making sure that these foundational skills you need to be able to do this thing you need to be able to send this email open up this thing click here find this that onboarding process for anything can be make or break because you can show up and go I don't I don't I don't know what to do with this I've seen this with actually several tools that were created in-house and a company to help secure whatever it might be and it really did they were like this song so my problems and nobody was using it and you asked

why it was because they would open it up or they didn't know how to open it up it was at first I don't know how to navigate I don't know what I don't what to do with this the creation of foundational skills for that product was shot so nobody would touch it it's a huge part of so that very first part of a game even if you're like oh it's just that first initial area it is really one of the crucial things about anyone even starting a game all right the other thing you have here is a high reward schedule I we all know what this is right Mario love i love this game i was

recently we're gonna go a slight tangent i was recently talking to somebody that wasn't born in the 80s and I said oh man super mario brothers and they're like yeah I was super sweet on nintendo 64 I was like oh but I remember it on Super Nintendo what it just went left to right that I felt so old anyway feds fights details so with this this is the first level like this is the first two seconds they move forward and your for reward standing here and we're so used to it because you played it so much but the reason for this high reward schedule in the beginning is that you are literally a rewarding navigating the game so let's

try to break this out a little bit in order to get through this what I'm what do I have to do let's point out first behavior what are one of the things i need to do to successfully get to that green tube we're gonna run i got to move forward sweet i got to move forward great so moving forward we got that one you said something just to pick one to jump it hit the box suite now I know what this does it gives me points I just rewarded you awesome that means I'm gonna want to hit those two what else you have to do you're gonna go home huh you gotta killed that guy which means hey you might actually

fail you might run into and go like this look you might do that let's just go oh no but guess what you get another life um you've now on you now understand this is a bad guy this is how I go forward if I just go forward into the bad guy I will go like this um I hit this oh my gosh I got a reward is there something here sweet sweet what's here which one of these has the cool thing treasures i preciate for fun so you hit you can sweet coin coin oh boy this is so I'm gonna grow up here and find this one and it's a coin but what if you're doing it

and then you also hey maybe you didn't get the jumping thing down what else do you find out about these they break if you hit them and eventually in some levels that is important you have to break them so in this small space right here you have learned how to go for how to navigate how to jump how to avoid an enemy what an enemy is what these mean what this does and that oh my gosh some of these have cool things that I make bigger this is exciting you will know that and the reason you explored that is because they were awards there was things here they rewarded you for doing this and you learned a lot about the

navigation in this short period of time this is very important for starting the beginning of the game and the same thing with the beginning of your behavior so I've helped some people or organizations create fishing strategy you know you have your training one of which is reporting you really want to know what's going on you really want to know reporting so what we do is they want them to send them an email don't reply to it send it to this email address and one of the things that I found that is massively successful for this and getting this behavior to actually go they know how to send an email is you send an autoresponder to go I got it and

I thank you for that I appreciate I appreciate you sending this this to me why do you think that's effective they can even know it's an autoresponder they just got an email why do you think it's effective why doesn't reward you get rewards your behavior what so you said somebody's way somebody's watching it you didn't just go into random space you're just like I sent it and even if you know it's an autoresponder it rewards it even just a little bit and you know somebody heard me something similar how do you this actually Amazon does this too can you guess where it is amazon employees the same tactic of rewarding him when you make a purchase where do you think it is

nadeyus hmm and you're okay in your list of orders okay in an email confirmation you get an email it says hey I got it and here different stuff you couldn't I but strangely enough i've seen so many people they go great amazon amazon amazon great i submitted it i got your order and they go straight to their email to see the confirmation that not that their word has been shipped but it was acquired it's rewarding because you know somebody hurt me and i have confirmation of it same thing happens with flights I've heard so many people don't give a confirmation email did you look in your spam folder did you turn it on or off again stuff like that it it's

a rewarding behavior and it's very small and what you're doing is you're training up the behavior i want you to email me heard yet here's your pumpkin it's there what are some other examples for more complex tasks whereas like you see more frequent rewards in the beginning what do you what kind of examples can you think of what way right before boss fights yeah what what does going when you meet new characters sometimes you'll stuff that's actually kind of funny I'm psychologically speaking that's to battle some of our inherent worry of strangers but if you wait yeah so right before Boston's what usually happens before a boss why I mean because actually can it starts to create anxiety

because I you usually get these things and you're like oh no what's the rounded corner what usually happens before it how would you help packs power-ups savepoint you suddenly are like when you got all these things what are you preparing for I don't know what to do yeah yeah now you start to be able to recognize these things and you're getting rewarded to go forward I'm so it's really interesting but this is the beginning in the beginning of a game you have a high reward schedule but you cannot maintain this type of reward schedule all throughout because it just becomes nothing so what ends up happening is as you start coming up that curve things become a little bit more

difficult you break it out you now go I need you to put forth more effort and more time to get more rewards and that is another talk in itself but that were rewards schedule schedule is amazing because if set up correctly that's how candy crush and things like pop that pop games that's what they mastered was the ability to space out rewards effectively to wear even though it's hard they still looked I have to have lives but have lives so if you're going to give them anything it really is up the other thing you have to do is starting a game is make sure players are placed within their skill level and this is both make sure they don't go too far

and make sure they don't come too far back so again think about it with training have you ever gotten raising your nape you've gotten to training or maybe gone to a talk or a class where it was you're just like I have open to deal with this means yeah okay no idea what this means did you like it did you learn anything did you pay attention so you learn something good yeah what happens in the other direction you show up and how did that go it's so like you know all these as a matter of fact you wrote the book on them but you have to pay attention to it have you add those kept

you pay you play on your phone that's great I did that in college that's great it's always bad when you're you're emailing the instructors might was I only did once will I learn my lesson I was in class my advisor was the instructor they had sent me an email and i responded in class so expected I appreciate the work you do this these statistics are great but I was like but blood wasn't flawless she's a gap but I see the time you sent me was directly the middle class you remember we did I was like oh um yeah I just used boomerang yeah she's been wearing so anyways it was way fun but you have to

make sure that people are placed within their skill level because it either goes completely over their head they don't learn as much and they just too difficult or they don't pay attention another problem so I have guitar hero here this is the ID play guitar here right I like jammed out on this like a boss and it of course made me a better guitar player right yeah I did I totally like for by the end of it took some time anyway so you have you have your easy and you have your expert and just think of it if this was the beginning if this is what guitar hero started with how well do you think it would have gone

really well yeah because you have to make sure that the players are placed within their skill level when it comes to real world this can be much more complicated because with this see with this you know their skill level they didn't have it and they're just new thing that they had to mess with so you gave him something easy but when it comes to the real world and you're dealing with creating teams like pen test teams you need to know how good they are because it's very easy to change that so really know your audience we got it so manipulating the curve now we need to know about how to make things easier so we have the it's too hard

right they need to seem easier sometimes you can make them easier you can do certain things you can get certain tools but one of the things is you break it into subtasks so rather than just going great i did here to there you break it into smaller increments of time or smaller tasks and what this actually allows you to do is reward more frequently and it makes this why i say it makes it seem easier because they're still acquiring the skill but you're going let's focus on this and if i actually were to expand this out and do this this is a shallower learning curve then this one and then the whole thing and what it allows you to do is both

create milestones but then you also browse you reward more frequently versus just going it's too hard and I'll reward you and get to the top so one of the things again to make it seem easier to break it down into subtasks and then within those subtasks checkpoints whatever it might be reward this happens in games a lot it's fine did you guys ever play cruisin USA remember the yes pretty bored there were checkpoints and there's girls it came out with like this um what happened did you ever go back to the checkpoint no nothing happened it was a checkpoint tell you like a dog you made it you got this far it doesn't matter i'm not taking back there if you

guy but we made it it was the idea of breaking it into subtasks you do you can do this i'm sure you can come up with examples of this happening all throughout your job the other thing you can do to make something seem easier as you provide outside tools this is what training was originally supposed to be it was supposed to be oh hey you you want to learn about verb sweet okay you don't know town about it I'm not going to sit here but look at all these resources here's a whole bunch of training on that with mario kart it's mainly multiplayer game like yeah you can play single player but it personally you can fight

with me later it's multiplayer single players in here so you can go play certain bubbles I feel like I really want to get good at Rainbow Road because I was fought the end oh that one so you go play that one over and over and over again and you go hey guys you guys want to play rainbow road I'm okay I didn't know yeah there's that one also the same thing with guitar hero up there I'd actually broke it down into specific spots you can play certain risks to get better at it and then go play so this is another thing to provide outside tools for practice so now we're going to talk about the idea of how to make tasks more

difficult sometimes it's just too easy you have a really sophisticated team it's too easy what is this so what yeah I was introduced is very recently it seems pretty cool oh by the way you're on a same thing to you got the last one good for you I shouldn't have told you the last one now because now you know the rewards are gone but so you're just like output so anyway hi this is this is a pretty pretty cool task um that was going on so making cast more difficult one of the things you can do is add sub skills so does anyone recognize this one it's called by control it's pretty fun it's super in super time filling but

what the basic premises is you have different planes and they're color-coded to have to go to color quoted runways helicopter esco the helicopter so on and so forth this is an easy spot and what ends up happening to make things more difficult because if it was just this what ends up happening over the more you exhibit of the planes crash oh no like you're horrible air traffic controller reasonably so and you are done so what what is it happening over time is that more and more planes come in well then sure that gets boring so rather than just being like oh let's just change it completely you start adding sub now we're going to add different runways

you have to employ different techniques there's wind and the idea of volume all come together to you have to complete this task and then eventually just turns into a cluster and you're like oh what's going on it was really funny with the most hilarious thing about well I thought it was hilarious friend of mine as a pilot like a commercial pilot he would play this game and just complain that works their helicopters go faster than that and I'm like well it's a game um yeah well cool so there's really funny to get a commentary on that one so add sub skills under current skills to make things more difficult and you see this a lot with teams where rather than

just going I learned these tasks you have to learn a basic and then you have to add on to it and kind of integrate into it and then you have to keep going and those are those complex tasks you also probably do it personally if you're progressing farther and farther you don't just go good i achieved the skill it's not hard anymore done usually if you keep going you find another skill to bring into it that's usually where for example some of some of the best bug bounty hunters that I've seen are ones that have other skills and they're starting to stack it on top of each other and they become creative and point different things and they do it it's

very interesting to talk to them because they're not doing it so much for the actual extrinsic motivators of money because a lot of them actually do it for the types of charity if you talk to some of them it really is because they're like I like the challenge it's what I do in my off time it keeps me an eel actually stimulated so they're doing things on their own to add sub skill and under the current skills it's kind of cool that's one of those things you actually see just happen the other thing that you can do is you add things into the environment this is portal 2 and what this is is is is it the spot in the

game where you pretty much figured out that is anyone not familiar with portal or pearl joke like a fool it what you have is this cool gun and you make holes in the wall essentially you can walk it's pretty cool so if I put a hole there and over there if I walk through them this other Cole so the game progressively makes it more difficult by having to put things different places and then having to employ strategy of moving it to different spots but the time that you're pretty proficient at it it's suddenly add something to the environment a goop of some sort some of them make it slippery some of them make it bounce and now not only do you have

to do this skill but you have to use this skill with the goop and once you've perfected the I think this is the slippery one and the green one is the bouncy one are the purple ones bounce away or the orange one there you go you like oranges horn Katie wait yeah there you go so pretty quick so once you pretty much mastered this one then all sudden we introduced the other one and the interesting thing about about it is that you will have them in isolation for just a little bit until you've gotten it down quicker and then they mash them together like do even do them in conjunction with each other so you start

adding things into the environment and the next thing you do is you start adding things elements for complexity not just environment but for example like when you play Goldeneye so this isn't just a bad picture it's because this is how gold my looked I kept trying to find more pictures I was like Hardison oh this is actually pretty bad let's just wait it cool so what this is remember that suddenly the grenade launcher you got access to the grenade launcher it added a complexity because you can just like Oh again I got shot I'm gonna run it's like oh no I'm just dead good good not have to keep track of that so you started that's when you

started a lot of people started paying attention to what everyone else had and knowing where they were so that you knew if you were in the line of fire if they could get you so you start becoming more complex you get tools that make things harder so in conclusion okay so it's this concept of beyond the badge when you're when you're taking all this idea of a game and applying it to the world you have you want to keep your target audience in mind you want to know the behavior that you're interested in is that linear is a repetitive eighty percent of training needs to be either a time filler or in the gray area design

onboarding is amazing you've just a variety of different things but you use all of these different types of gamification techniques to prevent that it's really what it is because if you can effectively employees you can both you can improve your own performance you can decide I'm bored at my job I'm really irritated what do I need to do to make this better that means you've gotten to the top that's when people usually start seeking out others other things that are task skills they start learning on their own to make it more complex if you're creating a team how do you engage them the votes you have t mean switching teams around to encourage learning and engagement

it's amazing things to do you see a lot of these types of things providing outside resources and making sure that they're the most effective big one as well and this is another one if you have more you have more interest at some point extrinsic versus intrinsic motivators money you'll you'll lose it quickly and it doesn't have as much power as an intrinsic one which it really very much lives within these so you can accurately go beyond just badges and employ gamification techniques and how they become so addicting you can prevent in crime Clemente crying a lot so thanks guys I have no time right I have no time so no questions I drop the mic here