In this solo episode, Cary introduces a practical way to use ChatGPT as a consistent review and scoring tool for work you produce or evaluate over and over again. The idea is simple: most of us review things on instinct and experience, but if you can articulate what you're actually looking for, you can build that into a reusable editor inside ChatGPT or Claude. Cary walks through his four-part framework for prompting and shows how to have the conversation that turns your review instincts into a structured scoring matrix. The big takeaway is that putting your review process into words, even for things you do on autopilot, makes your feedback faster, more consistent, and more objective.
3 Key Takeaways
If you review or produce the same type of document repeatedly, you already have a mental checklist. The goal is to get it out of your head and into ChatGPT so it can do the scoring for you.
Use Cary's four-part framework to build the tool: tell it what you're doing, why you're doing it, what success looks like, and then invite it to ask questions before it gets to work.
Once ChatGPT interviews you about what "good" looks like in each category, save that output as a project instruction, a custom GPT, or a Claude skill so you can use it over and over without starting from scratch.
Giveaway Winner: Congratulations to Heather Thorson of HT Artistry, who wona free ticket to AI Business World in Anaheim, California at the end of April. The ticket was generously provided by Michael Stelzner and Social Media Examiner.
Cary offers customized one-on-one ChatGPT training in 60 minute sessions. Find out more information on the sessions, answers to frequent questions, and how to register at www.ChatGPTExperiment.com
Ever notice how ads always pop up at the worst moments when the killer's identity is about to be revealed?
During that perfect meditation flow, on Amazon Music we believe in keeping you in the moment.
That's why we've got millions of ad-free podcast episodes, so you can stay completely immersed in every story, every reveal, every breath.
Download the Amazon Music app and start listening to your favorite podcast that free, included with Prime.
Security program on spreadsheets, new regulations piling up, and audit dread? It's time for Vanta.
Vanta automates security and compliance, brings evidence into one place, and cuts audit prep by 82%.
Less manual work, clear visibility, faster deals, zero chaos. Call it compliance, or call it calm compliance.
Get it? Join the 15,000 companies using Vanta to prove trust. Go to vant.com slash calm.
Hey, it's Carrie. Hey, this week on the show, I'm talking about how to build a review editor and scoring matrix for work
that either you're doing or doing for other people to help you be consistent, thorough, and scalable.
And I've got a winner in our AI business world giveaway. So if any of that sounds interesting to you stick with me, and I'll see you on the other side of the music.
Hey, welcome to the chat TPP experiment. This is the podcast designed to help you better understand tools like chat TPP.
So you can find a thing. You can find a nugget to get some value for your personal or professional needs.
My name's Carrie Weston. I'm your host. How you doing? We are in March, March and Maine. It's that in between season.
We're starting to get hope, a little optimism that the snow that's all around us is going to go away soon.
And with it comes not green grass in Maine, we call it mud season. It's an official season up here in Maine.
And just to share with you a little bit of the optimism, I probably did one of the most main things I've ever done this week.
My boat, I have a pontoon boat and it's stored on the lawn out at camp. And on that lawn at the moment is 10 or 11 inches of snow.
And I want to get the boat. I need to do a couple things before sun comes right before the sunshine and the boat season comes.
But I also want to be ahead of everybody else because if you wait too long, then you're going to be in line.
And honestly, the boat's going to be sitting in someone's parking lot when it should be on the lake. And I don't want that to happen.
So I took the snowblower. I loaded up the snowblower on the truck, took it out the camp, snowblow to path on the lawn so I could get my truck on there and hooked up the boat.
And dug it out. And just this afternoon, dropped it off down at the marina. And probably goes without saying that I was the only boat that got dropped off this early in the season.
But early bird, right? Early bird gets the worm. So I'm hoping that I can be up and running and totally ready when that first sunshiney day comes.
That's what's keeping me going as we look up the window to the snow.
Hey, I've got a winner in the AI business world ticket contest giveaway.
That's that trip. I was telling you about the end of April that Michael Stelsner there at Social Media Examiner was kind enough to offer up.
I've got a drew a name. I'll share with that here in a minute.
And the thing I want to talk about today is, let's just call it a scoring matrix.
It's a review, kind of an editor. It's a scoring matrix.
And I guess that's the best way to put it. Think about this way.
Do you have something that you produce over and over again?
Or do you have something that someone else produces that you have to review over and over again before it goes out or before it gets sent to somebody?
Put yourself in a situation to think about this.
Do you have a document or a process or something that you do over and over again that either you're reviewing your own work before you give it to somebody or you're reviewing it on behalf of somebody else?
If you do, then you probably have, let's say standards or categories or aspects or something that you're looking for.
Maybe we don't think about it that way very often because a lot of the stuff that we do over and over again is just kind of instinctual, right?
Not many of us have a checklist. Some of us do.
But not many of us have an official checklist that we go through. A lot of it's just experience and instinct.
But I'm sharing with you that if you can create some sort of checklist on if you were to replicate how you review.
If you were to replicate how you evaluate, how you edit, what are the things that you're looking for?
If you could create that checklist, then you have the opportunity of creating a scoring matrix tool or review or an editing or a critiquing tool in a tool like ChatTPT or Claude.
I find myself using Claude a lot, especially for writing.
I find that it's warmer, it's more human, it's more empathetic, it's better writing.
I use ChatTPT a lot for brainstorming and for functional purposes.
But I've found that over the last, I don't know, four to six months, more and more of my writing is being done in Claude.
In fact, I even compare the two or have the two compete. That's what I want.
If I create something in Claude, I'll share it with ChatTPT and vice versa.
I'll say, Chat created this, can you review it and let's make it better in the other way around.
It's amazing how competitive the two can come.
But I also get what I find some analytical and some empathetic kind of advantages by doing that.
Because it's almost like two different brains and sometimes you'll find something using ChatTPT as a reviewer that Claude missed in vice versa.
And so in a lot of the work that I'm doing with clients, we're getting to becoming more and more comfortable and consistent in using tools like ChatTPT and the work that we're doing to create outputs.
Now we're evolving to, let's make sure that you're reviewing consistently, that we're editing consistently, that we're critiquing it consistently.
To share with you this, the ability for you to create that checklist and to think about what are the elements that I look for, what are the things that I would critique, what would be the feedback that I would give somebody, even if that somebody is yourself in terms of what standard you're writing or creating for.
So that's the first thing you want to do.
Let's think about that for a second, because in order for a person, remember we call ChatTPT our amazing intern and we think of it in terms of a person rather than a piece of computer software because it helps us kind of have conversations and think about how to work with it.
So in order for us to do that, in order for us to scale any sort of activity like a reviewing or scoring matrix or something like that, we have to give it the structure, we have to give it the information that we wanted to review.
Think about that for yourself. What would I do if I were to create a checklist on the categories of the attributes or the elements of this, right?
And you might come up with four or five.
And then, you know, you can do one of two things.
You can try to give some depth to those four or five things, those attributes, or you could feed those attributes into ChatTPT and say,
I need to create, you know, structure around my reviewing process because I want to create a scoring matrix.
So here's how we'll do it.
You have heard me say before that I have a four part framework for having productive conversations with tools like ChatTPT.
And that four part framework is this.
Number one, always identify what we're doing.
Number two, why are we doing it?
Number three, what does success look like?
And number four, giving it permission to ask me questions. Do you have any questions from me?
Okay, so in this instance, if we want to follow that framework under the guys of the review, we would share with it.
Listen, I create, this is like the conversation I would have, right?
I create, and let's just call it a sales proposal.
Okay, we'll just follow that matrix at the moment.
I create sales proposals over and over again.
Or someone else creates sales proposals that I review before they go out.
And I want to make sure that not only are we being consistent and true to what needs to be done, but we're doing our very best work.
So I want your help.
I need to create a review editor.
And I want to create a review editor that will review and assess on the following elements or attributes.
Or areas that, and this is the, you know, the areas that you've just determined, okay?
And you'll list them, okay?
And again, this is the same conversation. This is one conversation.
And I want you to help me score the work from zero to five on each of these elements or categories or attributes.
Zero being not even close and five being absolutely perfect, and obviously there's variance between.
My goal is to always have at least a four on all categories, okay?
How would you suggest that we proceed?
Okay, what questions do you have from me?
How would you suggest that we proceed?
And I would leave it at that.
Now that's not an exact prompt, but you can see the conversation going.
I've just, I've shared with them what we're doing, and I'm sharing it why we're doing it.
And I've determined what success looks like.
And then I've given it permission to ask me questions, and I'm asking for its feedback.
Okay, so again, I want to create this. I want to make sure we do our best to work.
I want to create a review editor.
I want to review on the following elements or categories.
I want to score each of the categories zero to five, zero being the worst five being excellent.
My goal is to always be at least a four on all categories.
How would you suggest we proceed?
Now here's what's going to happen when you have that conversation with chat,
GPT or a cloud or the tool that you're using.
It's going to understand what you're doing.
It's going to understand the context.
It knows now what output looks like.
And in some form or fashion, it's going to start to suggest that in order for me to score,
I need to know what the categories are.
Maybe you've told it.
But I need to know what good looks like.
So it's going to walk you through questions.
Help me understand what good looks like.
Help me understand how you perceive in each of these categories what is or not good work.
And then when you're done, you're going to walk through.
It's going to interview you.
You're going to talk about it.
And you're going to end up with a long list of instructions.
Now here's the kicker.
When you're done, when you've interviewed you, you know, ask,
how can I use this?
How can I use this?
Can you export or can you can you create a final output that I can save and use over and over again?
Or perhaps I'm going to go over and create a custom GPT.
And if you're using chat GPT or a project, if you're into projects,
if that's the case, then again, give it the directions.
I want to take what we've just done.
And I want to add these as instructions to a project or add these as instructions to a custom GPT.
Or perhaps you just want to have one final output that you can save and use over and over again in the same conversation.
If you're using cloud, this could be, they call it a skill.
In cloud, you can literally say, okay, let's take the work that we just did and create a skill from it.
And kind of like a custom GPT and chat GPT, cloud will create a skill,
which is a reusable component that it refers to over and over again to help you do the work.
Or just like chat GPT and cloud, you can perhaps put instructions into a project.
But the key here, no matter how you use it, the key here is to tell chat GPT or the tool that you are in need of creating this editor.
Give it the elements and then have it work with you to pull from you, have it interview you,
to pull from you what good looks like.
And it may ask you, when I did this with a client, it asked me for examples of what good looks like.
And that's even better because it can analyze, right?
It can analyze what good looks like and bring that in.
But the goal here is to define the elements and the range by which what bad and good looks like.
You're going to be, you're going to be, I said, jump impressed or relieved or perhaps even surprised that when you take time to spell out what you think about intuitively,
the ability for this to think like you to help you to help you be more efficient and to help you rate and score is going to make things much more efficient and consistent for you.
Okay, so when you're done, the output is going to be, let's say you've got a sales proposal.
This is how you would use this in the end is I want to use my editor, my reviewer, my critique tool that we created.
I upload the proposal, I share the proposal and I say go to work, right?
Now go to work can mean in the simplest form, you've just got a conversation that you use over and over again because you've created this prompt, right?
Or if you've created a project or a custom GPT, you've added it to it.
But you can say listen, I want to use this reviewing tool, here's my proposal, go to work and it'll give you an outline of its analysis.
It'll give you the five, let's say the five categories you gave it, it'll rate it and give you suggestions on how to make it better.
Now how you do this is really up to you, what I'm giving you is not gospel, this is not a black and white copy, paste this and everything's work.
What I'm trying to give you is the structure, the framework to have the conversation with chat GPT or the tool of your choice so that you can think about how you evaluate, how do you score, how do you could treat, how do you review, how do you edit.
Most of us don't think about that, I think that's the bottom line here that I'm finding is most of us don't think about how we just do it, right?
And even at the very least, even if this helps you find things that you haven't thought about, right?
You're making the review process more objective and you're making it faster, more efficient for you, okay?
So think about that, how can you take something that you do over and over again and expedite the process by sharing with it, why and how you review and what you review it for.
Right? Let me know, I would be interested to hear how you're using something like this already if you are or if you give it a go, if you have a conversation, share with me how it went.
I'm finding that it is helping others see objectively because we get so into the weed, don't we?
I've said it before the cross of knowledge, sometimes it's very hard to look objectively at something because we've put so much time into it or we do it over and over again and it's hard to tell you this is specifically it's hard to think about the other person, right?
It's hard to put ourselves in the position of the other person that this document's being meant for.
I said the sales proposal was something as an example.
It's difficult sometimes to put yourself in the seat of the customer and look objectively at a document and act as if we don't know everything that we know, you know, that curse of knowledge is real.
So the ability for you to define what the scoring matrix is and define the elements of what good and not good look like will help give you an objective set up objectively for the audience and the purpose that you're creating.
So I hope that was helpful. And again, share with me any feedback. Give it a go and let me know, let me know how you do.
Okay, let's get to the giveaway, drew a name and the name is Heather Thorsten.
Heather Thorsten of HT Artistry and I did a just a quick look looks like Heather's down in Boston.
So congratulations Heather.
Tickets to a business world out in Anaheim, California at the end of April.
Thanks to Michael Stillsner, social media examiner, I think you're going to have a fantastic time. Heather had mentioned in the entry that she came in that she has been captured by all the various ways to leverage AI, but she knows she's only scratching the surface.
I would love to attend the conference so that I can learn but also share with my industry peers.
I've always been fascinated with technology and I'm always looking how to incorporate new tools to expedite processes.
Well, Heather, I think you're going to find just plenty, plenty out there for you to benefit from it and to learn and some great people to mingle with.
So congratulations, congratulations to you Heather.
And like I said, I will send you out an email so you can get the details from me there.
Well, that's it for today. Hope springs eternal. So as I look out the window here, hopefully the amount of snow goes down and down and down.
But I hope you find some value from here. Again, let me know how you put this to work. Let me know the kind of the outputs and what you found.
I always love hearing from your chat GPT experiment.com as we will find ways to get a hold of me and all of the episode archives.
The first time listeners welcome to the show. I've heard from a number of people here the first of the year that they're just now getting into chat GPT kind of exploring.
And they've gone back into the podcast and have found it terrifically helpful. So I do appreciate that. If there's a topic that you want to hear about, shoot me a note.
I'm always looking to make the show more relevant and valuable to you.
So if there's something that is on top of your mind, shoot it in. Love to have a conversation about it.
And otherwise, as I say, the most important element to becoming more comfortable and efficient with chat GPT and tools like it is your own curiosity, okay?
So until we talk again, do stay curious. Bye-bye.
Working across teams is tough, but Asana helps you handle it.
That's because Asana is where humans and AI coordinate work together.
AI can spot roadblocks and assign work in a snap. So everything and everyone stays on track.
That's how work gets handled. That's Asana. Visit us at Asana.com. That's ASANA.com.
More from The ChatGPT Experiment - Simplifying Chat GPT For Curious Beginners