15
$\begingroup$

This function does not work correctly for me. The generated Gravatars do not match the ones actually produced by using the corresponding address.

The problem was traced to differing output from the Hash function.

VLC points out that the Hash documentation pages for version 7 and version 8 have common examples but show different outputs.

From version 7 I get:

IntegerString[Hash["[email protected]", "MD5"], 16, 32]
"cc270b8fbfb33469629c14e358183dd7"

Version 8 users apparently get:

"d9c48b644b8cc89bbcd07ec7a54dafc9"

Why do I get a different result and how do I get the right one?

$\endgroup$

3 Answers 3

9
$\begingroup$

Older Mathematica versions were including the enclosing quotes "" when generating the hash.

To get rid of the quotation marks you can use the function below instead of the standard Hash function. The credit for the function goes to Mark Fisher.

StringHash[string_String, type_: "MD5"] := 
  Module[{stream, file, hash}, stream = OpenWrite[];
  WriteString[stream, string];
  file = Close[stream];
  hash = FileHash[file, type];
  DeleteFile[file];
  hash]
$\endgroup$
16
$\begingroup$

I believe that the difference is that the Hash in v7 was hashing the quotation marks around the string, but the Hash in v8 does not. For example, in M7:

In[1]:= Hash["test", "MD5"]

Out[1]= 64111166190477440563271147919838643147

and in M8:

In[1]:= Hash["\"test\"", "MD5"]

Out[1]= 64111166190477440563271147919838643147

Therefore, I'd say that the M8 hash is the correct one.

Note that it appears that FileHash has not changed across versions. The following hash function will produce the same results in v7 and v8, although those results will not be the same as what you get from Hash in either version:

myHash[expr_, type_] := Module[{fname, res},
  fname = Close[OpenTemporary[]];
  Put[expr, fname];
  res = FileHash[fname, type];
  DeleteFile[fname];
  res
  ]
$\endgroup$
3
  • $\begingroup$ I believe you have the reason, but the proposed function does not give output that matches the v8 Hash function. Did you test it? $\endgroup$
    – Mr.Wizard
    Oct 23, 2012 at 17:24
  • $\begingroup$ The point of myHash is that it will return the same results in v7 and v8. However, these results will be different than the results from Hash - it is not intended to reproduce the result of the v8 Hash in v7 (it looks VLC has a more clever approach). I will edit my response to make this more clear. $\endgroup$
    – KAI
    Oct 23, 2012 at 17:30
  • 1
    $\begingroup$ Strongly related SO question: "Cryptographic hash (sha1 or md5) of data given as a string in Mathematica". The answer contains another workaround. $\endgroup$ Oct 24, 2012 at 1:33
9
$\begingroup$

As an alternative to the solution by @VLC / Mark Fisher, the following JLink code will compute the correct MD5 hash (as returned by V8 or Unix md5sum):

Needs["JLink`"]
LoadJavaClass["java.security.MessageDigest"];

md5[s_String] :=
  JavaBlock @ Module[{d, b}
  , d = java`security`MessageDigest`getInstance["MD5"]
  ; d@update[JavaNew["java.lang.String", s]@getBytes[]]
  ; b = JavaObjectToExpression[d@digest[]]
  ; StringJoin @@ IntegerString[b /. n_?Negative :> 256+n, 16, 2]
  ]


md5["[email protected]"]
(* d9c48b644b8cc89bbcd07ec7a54dafc9 *)

We can use this function to see how V7 is adding quotation marks to a string before hashing:

md5["\"[email protected]\""]
(* cc270b8fbfb33469629c14e358183dd7 *)
$\endgroup$
1
  • 2
    $\begingroup$ +1 -- incidentally I tried a Trace[. . . , TraceInternal->True] on Hash and it seems to already be using Java. It's also almost comical how complicated it appears to be. $\endgroup$
    – Mr.Wizard
    Oct 23, 2012 at 18:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.