General Discussion

General DiscussionValve (specfically Gabe) talks about Dotabuff

Valve (specfically Gabe) talks about Dotabuff in General Discussion
Sar

    "The rating system that they're using is an internal one, that we think is kind of crappy. We think the idea is fine, it's just a lousy implementation. And the change that we made was specifically to give users more control over how their data was. And the DotaBuff guys sort of wigged out about it. So we think we're making the right decision on both of those. To give users a better more robust mechanism so that users know how well they play, and also make users feel like... So one of the important characteristics of a system is how true it feels to people, that's something we're always conscious of. We want to make system that feel trustworthy. Because there's actually a lot of real economic value to having a system behaving in a predictable fashion. That's sort of a long-winded way to say that we think we did the right thing."
    Will you ever implement a rating system?
    "Oh yeah, we're in the process of doing that. We think the one that's currently in it is sort of a crappy one that we did before we had a better idea of how to do it. We want people to add value, because that's what we think is the key to successful games. To enable people to do stuff like, generating replays, commentary, coming up with clever ways of evaluating players. All of them look like content creation, things we have to fit into a framework if we're properly designing it.

    Link to Audio: http://goo.gl/j7b2p

    Anakat

      why don't they just integrate dotabuff ingame or simply buy it

      Just(wiNner

        its been a while since the last time i heard good news about dota2

        Tormenta de Cielo

          I don't know. Dotabuff filled/fills a void that Valve still has to work on. But, hopefully they will start working on a similar system inside Dota 2 itself.

          crying

            Im going to see some retarded ranking where newbs will have high mmr and good players will have shitty ones.

            Cheynio

              Great to know that are doing to get rankings.

              crying

                And so we gonna wait another year to see this thing made.

                Luuk-

                  "Oh yeah, we're in the process of doing that."
                  This might take some time guys, Valve time and stuff.

                  Guile

                    Personally, while the Dotabuff stats are nice... I feel they cannot give any true rankings cause all the matches are public. As in, no public match vs ranked matches.

                    Until then, Its nice to see I am a good pub stomper, but its not true rankings.

                    Jack, Jacky, Jackie

                      i had a few holyshit streak in my previous game,but why is my DBR still remains the same? is it true that the DBR will determine the quality of the players we meet in match making?

                      Autism is great

                        cu in a year

                        SHOW ME WHAT YOU GOT

                          Even when you people see that you're going to get what you want, you still manage to find something to bitch about. Amazing.

                          Trillo

                            "why don't they just integrate dotabuff ingame or simply buy it"

                            Because DBR IS kinda crappy, according to DBR a guy who plays only wisp with a friend is the best player in the world.

                            이 코멘트는 수정되었습니다
                            Gruncle PUXXY's Busy Glizzy

                              I was wondering how long it would take for my recording to make it onto Dotabuff. Hopefully it provides you guys with at least some measure of closure.

                              [SS] Dremora

                                Closure? All this says is "we're right and you're wrong" in the most vague possible way. Closure would be providing details about how matchmaking works, why it sucks, and what the plans are to fix it. All this does is confirm that they're aware of the problem but for all we know the plan is to just keep it even though everyone knows it's bad.

                                이 코멘트는 수정되었습니다
                                [SS] Dremora

                                  The biggest thing Steam should learn from this is that players want visible stats by default. Valve seems to have the idea that people's stats are on par with their social security number in terms of privacy. I've never heard of a game that "guards" people's stats and that's because no one wants that. Instead we get ambiguous and meaningless "performance bars" which don't accurately reflect on skill and don't provide enough information to truly evaluate performance.

                                  The solution here is so straightforward that it's painful:
                                  1) Set steam profile privacy to public by default and give the option to turn it to private
                                  2) Show us the matchmaking algorithms or at least summarize it for people to provide credibility and also to allow others to offer input on how to improve it
                                  3) Publically show people's MMR or DBR or whatever. This again provides credibility because you can just look at your teammate's rating and know if the system is working as intended. If my DBR is 1800 and my teammates are all 1200 then there's obviously something wrong.

                                  Skraal

                                    Something has been wrong with matchmaking since the beggining and it still is. Even after hundreds of games you can still get paired with people that is trying heroes for the first time. I don't care if it goes public or stays private, but they've to improve it lots.

                                    AwesomeAL

                                      @[SS]Dremora:
                                      Thats why it is not public. They know the Matchmaking is not working. They say it is bad. If they would show how bad it is, guess how many people would quit playing/complain everywehere etc..

                                      Relentless

                                        Matchmaking is very hard. How long would you be willing to wait for how close a match? Is 2 min ok? There were 2.32 milllion matches in the past week. That's 460 every 2 min. If you want it on your favorite server maybe 80 in 2 min. How close do you want the match to your skill level? If its within 5% say range 1525 to 1675 DBR, now you are down to 40 people to fit into 4 teams...but what if you are also trying to match groups of 2,3,4, and 5.

                                        And then comes the really big problem. Are people in the groups of 2,3,4,5 all close in MMR? No they are not. One guy is Diamond and has 2 friends who are Gold, and they suggest Invite to their two friends one is Silver and the other Bronze. Now good luck matching that team to everyone's satisfaction.

                                        And there you have it: a total nub Bronze in your High ranked game on your team because matchmaking is trying to make up for the nub friend of the people on the other team. Your nub happens to feed more than theirs and you rage about matchmaking fails...meanwhile the game really was fair.

                                        Yoichi Isagi | Blue Lock

                                          dotabuff didn't ask valve to add value to my 38% win rate! :D

                                          Also nice statement, Relentless. It's obvious these people at valve are moneitizing Dendi & the stats.

                                          이 코멘트는 수정되었습니다
                                          cartographer

                                            "Because there's actually a lot of real economic value to having a system behaving in a predictable fashion."

                                            This line says it all. Valve knows two things:
                                            1. Existing statwhores aren't gonna abandon D2 over a lack of visible MMR.
                                            2. The majority of paying customers are casual players, so it's best to keep them happy.

                                            Relentless

                                              To bring it to conclusion: There is only one way to be sure matchmaking does not give you a nub player in a High level game. Don't give it a chance. Have a 5 man stack who you know are all competent. Otherwise stop complaining about your team because the other team got a nub feeder too...you just didnt take full advantage of their feeder and didn't TP into counter gank when your nub was dieing.

                                              Also solo matchmaking is really impossible to get right because of how vastly different each players play will be from hero to hero and huge differences with groups of 2,3,4,5.

                                              The only way rankings can be really accurate for a 5 v 5 team game is for a team of 5 players. Matchmaking has to be done so everyone can play and get a chance to win instead of getting stomped. But solo based matchmaking is not a legitimate way to determine skill in team game and never will be. Valve can't "fix it" because its impossible.

                                              All that said I would love to have the stats and stat based ratings all public because I enjoy competing for such things and seeing what other people can do. If someone wants to stack up 200 games of wisp-tiny great we can see how much can be done with that combo. It means nothing for "are they best at dota" but I still love to see it and let people try whatever they want to get whatever records they want.

                                              이 코멘트는 수정되었습니다
                                              MEATheals

                                                actually its not like that. there are tons of varibles you can't take into consideration while MM, and therewill always be imbalanced games. heck, there are severly imbalanced games when lower pro teams beat higher tier teams.

                                                KRB

                                                  Fuck this, im goin back to LoL.

                                                  russian plonker

                                                    they should make vip matchmaking like dota league had

                                                    Tex Hex

                                                      They should just copy the rating system from HoN. HoN's rating system is pretty accurate and the match making system tries to queue you with other solo players if you join the queue solo.

                                                      Dean Winchester

                                                        People want to know they are better than other people. Simple

                                                        Thumb

                                                          Wow. I see a lot of ignorant comments. Talking about how its simple to change and how Gabe thinks he is right and everyone else is wrong. We can trust Valve, they want whats best for the game and for the players. They want it to be perfect so we can spend hours and hours in Dota 2 and give them tons of money. Do I have to remind everyone that it still is Beta? They still have work to do and even if it does take another year, which I don't think it will, when Valve actually releases it everything will be all sorted out. Until then you get to play it and have fun with it while watching it get better and better as the time goes on. Just everyone shut the fuck up please lol, the game is still very good in its current state. Yes it needs work but if you are a PC gamer you should know that Valve is going to put the time and effort into supporting it and making it the best they can. Oh and btw, if your match fails to start and gives you "higher priority" while searching that means its trying to get you in a game quickly which might mean you get thrown into a game with people above or below your skill level. If you hate it that much then stop the search and restart it.

                                                          nes

                                                            I miss the ratings
                                                            even if i was a scrub

                                                            Relentless

                                                              Btw ratings and team ranking are supposed to come out with the next patch. I've very happy about the language option as well. Communication with non-English speakers can really be frustrating. I pick only US servers, but that doesn't seem to prevent me from getting games where I am the only one who speaks English.

                                                              Update Notes - February 6, 2013
                                                              - Added Team Matchmaking! Teams have a public rating based on their performance against other Teams.
                                                              - Added Language setting for Matchmaking!