From Local Descriptors To In Silico Labeling