Book of Heroes

They heard us; well done

I said before that the developers have a good track record of listening to the players and repeatedly asked people to have patience while they worked on things. I am thrilled that they have proved me right.

I have heard complaints that the raid is now too easy. Perhaps they went to something easier than they could or should have if they had done it from the start. But the very generous payouts and the substantial certainty that the raid will finish in gold time (with significant contributions now possible for lower might players), is making for a fun break from our normal raids and allowing most players to acquire all the gear they want in the admittedly limited remaining time.

From a game balance standpoint, is there a problem that a lot of players will have T17 weapons, more than would have been expected at the outset of the event, due to the dramatically higher payouts? Perhaps. But that's not as bad as having players leaving the game in droves.

Congratulations for ultimately doing the right thing. May I request that the developers do one more right thing? Take the opportunity to discover all the lessons this experience teaches, and not repeat the mistakes in the future. Three lessons that come to my mind:

1. Whatever algorithms you are using to choose the difficulty of raids have been, are, and continue to be flawed. Just because something looks good on paper doesn't mean it will work (be fun) in reality. I know you did not design the raid expecting that it would produce anger and repeated failure, but it did anyway.

2. That is why there is no substitute for testing something with real players, rather than just with developers. There are many of us who would be willing, I'm sure, to sign confidentiality agreements and assist with the testing process.

3. Reconsider the process of introducing things on Friday afternoons. The developers have lives and are entitled to enjoy their weekends. I can easily understand why this problem continued (and anger mounted) over a 4 day period, because you were not able to respond as quickly as you might because of the weekend. But there is an easy way to deal with this going forward. Start on Thursday and have "all hands on deck" to make needed adjustments.

Illy_the_Red

ModeratorWed Sep 17, 2014 1:05 pm
Derrin_Watson wrote:I said before that the developers have a good track record of listening to the players and repeatedly asked people to have patience while they worked on things. I am thrilled that they have proved me right.

I have heard complaints that the raid is now too easy. Perhaps they went to something easier than they could or should have if they had done it from the start. But the very generous payouts and the substantial certainty that the raid will finish in gold time (with significant contributions now possible for lower might players), is making for a fun break from our normal raids and allowing most players to acquire all the gear they want in the admittedly limited remaining time.

From a game balance standpoint, is there a problem that a lot of players will have T17 weapons, more than would have been expected at the outset of the event, due to the dramatically higher payouts? Perhaps. But that's not as bad as having players leaving the game in droves.

Congratulations for ultimately doing the right thing. May I request that the developers do one more right thing? Take the opportunity to discover all the lessons this experience teaches, and not repeat the mistakes in the future. Three lessons that come to my mind:

1. Whatever algorithms you are using to choose the difficulty of raids have been, are, and continue to be flawed. Just because something looks good on paper doesn't mean it will work (be fun) in reality. I know you did not design the raid expecting that it would produce anger and repeated failure, but it did anyway.

2. That is why there is no substitute for testing something with real players, rather than just with developers. There are many of us who would be willing, I'm sure, to sign confidentiality agreements and assist with the testing process.

3. Reconsider the process of introducing things on Friday afternoons. The developers have lives and are entitled to enjoy their weekends. I can easily understand why this problem continued (and anger mounted) over a 4 day period, because you were not able to respond as quickly as you might because of the weekend. But there is an easy way to deal with this going forward. Start on Thursday and have "all hands on deck" to make needed adjustments.

Agree completely with all three points. Like with moderation, there are always players (mods included) who would be keen to help. Something as simple as bouncing ideas off a large enough group of players (provided said players were adults and willing to be constructive) could avoid something like this. Point 1 is perhaps most important as whatever was used to come up with raid totals/difficulties for 1.6 was clearly used again here, despite the initial 1.6 raids provoking similar outrage to this event a long time later.

Possessed_Mithrid

Wed Sep 17, 2014 1:14 pm
Derrin_Watson wrote:
3. Reconsider the process of introducing things on Friday afternoons. The developers have lives and are entitled to enjoy their weekends. I can easily understand why this problem continued (and anger mounted) over a 4 day period, because you were not able to respond as quickly as you might because of the weekend. But there is an easy way to deal with this going forward. Start on Thursday and have "all hands on deck" to make needed adjustments.

As usual Derrin, all good point! Here have a cup of Joe with Baileys on me....oh wait...... nevermind, I think I have some Creamery Ice Cream around here, you'd appreciate that more. ;)

Venan, as for Derrins last point, I think this is a great idea...I volunteer for your first officially Sanction Player Beta Test group (unless one already exists..then I guess we arent supposed to know about it...please tell me BJ isnt the only beta tester in such a group if it exisited. :lol: ) ...it would be very interesting for me as I spend more time analyzing the game then I do playing it. :D
Couple o' things...

I'd like to add a 4/ - Have a contingency that can be rapidly deployed in case things go wrong. A lot of the upset was caused by the fact that things were bad from Friday thru to Tuesday - a long chunk of the event. Sometimes things don't work out as expected, and the ability to deploy an already-developed contingency in those instances makes it better all round.

I have a confession.

Despite all my bluster, bravado, and bluff, I have succumbed. I have 4 toons killing pirates at every opportunity. I started last night (UK time) and see no sign of letting up.
I was a harsh critic. But the review has done enough to win me over. Good work guys.

Darkhorse

Site AdminWed Sep 17, 2014 2:27 pm
Derrin_Watson wrote:I said before that the developers have a good track record of listening to the players and repeatedly asked people to have patience while they worked on things. I am thrilled that they have proved me right.

I have heard complaints that the raid is now too easy. Perhaps they went to something easier than they could or should have if they had done it from the start. But the very generous payouts and the substantial certainty that the raid will finish in gold time (with significant contributions now possible for lower might players), is making for a fun break from our normal raids and allowing most players to acquire all the gear they want in the admittedly limited remaining time.

From a game balance standpoint, is there a problem that a lot of players will have T17 weapons, more than would have been expected at the outset of the event, due to the dramatically higher payouts? Perhaps. But that's not as bad as having players leaving the game in droves.

Congratulations for ultimately doing the right thing. May I request that the developers do one more right thing? Take the opportunity to discover all the lessons this experience teaches, and not repeat the mistakes in the future. Three lessons that come to my mind:

1. Whatever algorithms you are using to choose the difficulty of raids have been, are, and continue to be flawed. Just because something looks good on paper doesn't mean it will work (be fun) in reality. I know you did not design the raid expecting that it would produce anger and repeated failure, but it did anyway.

2. That is why there is no substitute for testing something with real players, rather than just with developers. There are many of us who would be willing, I'm sure, to sign confidentiality agreements and assist with the testing process.

3. Reconsider the process of introducing things on Friday afternoons. The developers have lives and are entitled to enjoy their weekends. I can easily understand why this problem continued (and anger mounted) over a 4 day period, because you were not able to respond as quickly as you might because of the weekend. But there is an easy way to deal with this going forward. Start on Thursday and have "all hands on deck" to make needed adjustments.

And now, a magical a look behind the curtain!

1. We're constantly looking to improve this, and in this case the raid was designed with too high of an expected player efficiency rate. We modeled after an existing raid, but the problem there is that public raids don't operate at nearly the same efficiency as guild raids. We have known this for a while, but was an oversight on our part.

2. While I agree that ultimately testing with a larger pool would be optimal, there are unfortunately many technical hurdles here that are both time and cost prohibitive. This would require a rework of our development and live environments in an unrealistic way for us as a business. This also has connotations in the mobile space that don't exist in other spaces (such as PC or console games) regarding initial bundle size, the way betas are distributed, etc.

3. Absolutely agreed. These events will very likely start on Thursdays more often than not. This was an anomaly.

Famous_Fella_O_Nutella

Wed Sep 17, 2014 2:48 pm
Hurrah Hurrah! A big Thank you to the devs. I had a blast with the pirate raid today, the mood was totally great. This is what the game is all about.
Ilyana_the_Red wrote:
Agree completely with all three points. Like with moderation, there are always players (mods included) who would be keen to help. Something as simple as bouncing ideas off a large enough group of players (provided said players were adults and willing to be constructive) could avoid something like this.

I agree with this completely. A simple discussion between a group of very involved players may have prevented some of the troubles of this event.

I commend Venan for doing what they could to make this weekend's mistakes right.

Thank you, Derrin_Watson again, for giving constructive information.

Illy_the_Red

ModeratorThu Sep 18, 2014 12:56 pm
Darkhorse wrote:
And now, a magical a look behind the curtain!

1. We're constantly looking to improve this, and in this case the raid was designed with too high of an expected player efficiency rate. We modeled after an existing raid, but the problem there is that public raids don't operate at nearly the same efficiency as guild raids. We have known this for a while, but was an oversight on our part.

2. While I agree that ultimately testing with a larger pool would be optimal, there are unfortunately many technical hurdles here that are both time and cost prohibitive. This would require a rework of our development and live environments in an unrealistic way for us as a business. This also has connotations in the mobile space that don't exist in other spaces (such as PC or console games) regarding initial bundle size, the way betas are distributed, etc.

3. Absolutely agreed. These events will very likely start on Thursdays more often than not. This was an anomaly.

With regards to 2), what I suggested above doesn't involve software, betas or even taking a toon into a test situation. It would be one of you guys sitting down and crafting a forum post (or whatever medium you prefer) that basically says something like:

- We want to do x, it will be in the style of y
(e.g. We want to do a pirate raid, it will be in the style of Hunted in the Mists)

- There will be x many phases and x waves

- It will be here for x days/spawn every x mins

- These are the drops/rewards we plan

- What problems do you foresee, and do you have suggestions based around that?

I'd like to think that a focus group-style approach where players (customers) can voice their feedback in a proper manner would minimise (not eliminate) the chances of such things happening in the future. In professional settings I've been exposed to, each project (and I'm guessing you treat each event as a mini-project) would've been far more painless had the project leads simply got some feedback from affected areas prior to implementing their plans/changes.

This would not be for anyone's benefit but Venan's - no guild interests would come into it.
Ilyana_the_Red wrote:
Darkhorse wrote:
And now, a magical a look behind the curtain!

1. We're constantly looking to improve this, and in this case the raid was designed with too high of an expected player efficiency rate. We modeled after an existing raid, but the problem there is that public raids don't operate at nearly the same efficiency as guild raids. We have known this for a while, but was an oversight on our part.

2. While I agree that ultimately testing with a larger pool would be optimal, there are unfortunately many technical hurdles here that are both time and cost prohibitive. This would require a rework of our development and live environments in an unrealistic way for us as a business. This also has connotations in the mobile space that don't exist in other spaces (such as PC or console games) regarding initial bundle size, the way betas are distributed, etc.

3. Absolutely agreed. These events will very likely start on Thursdays more often than not. This was an anomaly.

With regards to 2), what I suggested above doesn't involve software, betas or even taking a toon into a test situation. It would be one of you guys sitting down and crafting a forum post (or whatever medium you prefer) that basically says something like:

- We want to do x, it will be in the style of y
(e.g. We want to do a pirate raid, it will be in the style of Hunted in the Mists)

- There will be x many phases and x waves

- It will be here for x days/spawn every x mins

- These are the drops/rewards we plan

- What problems do you foresee, and do you have suggestions based around that?

I'd like to think that a focus group-style approach where players (customers) can voice their feedback in a proper manner would minimise (not eliminate) the chances of such things happening in the future. In professional settings I've been exposed to, each project (and I'm guessing you treat each event as a mini-project) would've been far more painless had the project leads simply got some feedback from affected areas prior to implementing their plans/changes.

This would not be for anyone's benefit but Venan's - no guild interests would come into it.


If a focus group came about, it should include toons of all might, and levels too, not just from the high end guilds. Just to throw it out there