I came across scite.ai recently. It’s a tool that looks at how references to a paper cite it (considered as either supporting, mentioning, or neutral) based on the text surrounding the citation, and then link these back to the original paper. I think this has a lot of potential and that it could be particularly helpful when overviewing a new field where you are not yet familiar with what is reliable. It could also be useful for highlighting replicability/non-replicability, as there doesn’t seem to be an exisiting way to do this besides looking for a comprehensive review article (or doing one yourself!)
My understanding is that the scite works by doing natural language processing/machine learning on full-text files. I’m interested to hear what other IGDORE members think of this ‘computer-assisted’ way of judging scientific validity? Would a supported/questioned flag change how you judge a paper’s quality?
PS. it’s also fun to search for your own papers on scite, hopefully none are in question