Title
#dev
Ariel Shaqed (Scolnicov)

Ariel Shaqed (Scolnicov)

08/24/2022, 11:40 AM
TIL about Maven Central Search. We've been searching for a tool to find Java packages that provide a class. This does pretty much that; it could be useful for debugging shading failures. Example:
❯ mcs class-search -f org.apache.hadoop.fs.FileSystem
Searching for artifacts containing org.apache.hadoop.fs.FileSystem...
Found 743 results (showing 20)

  Coordinates                                                                            Last updated
  ===========                                                                            ============
  org.scray:scray-hdfs-writer:1.1.1                                                      13 Sep 2018 at 10:08 (IDT)
  org.scray:scray-hdfs-writer:1.1.0                                                      12 Sep 2018 at 11:45 (IDT)
  org.apache.hadoop:hadoop-common-instrumented:0.22.0                                    10 Dec 2011 at 04:33 (IST)
  org.apache.hadoop:hadoop-common:0.22.0                                                 10 Dec 2011 at 04:33 (IST)
  org.jvnet.hudson.hadoop:hadoop-core:0.19.1-hudson-3                                    03 Sep 2009 at 00:41 (IDT)
  org.apache.mahout.hadoop:hadoop-core:0.19.1                                            03 Apr 2009 at 09:53 (IDT)
  org.jvnet.hudson.hadoop:hadoop-core:0.19.1-hudson-2                                    16 Mar 2009 at 00:54 (IST)
  org.jvnet.hudson.hadoop:hadoop-core:0.19.1-hudson-1                                    15 Mar 2009 at 22:40 (IST)
  org.jvnet.hudson.hadoop:hadoop-core:0.19.1                                             12 Mar 2009 at 07:15 (IST)
  org.jvnet.hudson.hadoop:hadoop-core:0.19.0                                             11 Mar 2009 at 08:02 (IST)
  com.tencent.bk.base.datahub:hadoop-common:2.7.3-bkbase.1                               26 Oct 2021 at 06:51 (IDT)
  org.apache.hadoop:hadoop-common:0.23.11                                                19 Jun 2014 at 17:17 (IDT)
  org.apache.hadoop:hadoop-common:0.23.10                                                03 Dec 2013 at 07:46 (IST)
  org.apache.hadoop:hadoop-common:0.23.9                                                 01 Jul 2013 at 17:45 (IDT)
  org.apache.hadoop:hadoop-common:0.23.8                                                 28 May 2013 at 18:27 (IDT)
  org.apache.hadoop:hadoop-common:0.23.7                                                 11 Apr 2013 at 21:26 (IDT)
  com.google.code.maven-play-plugin.org.apache.hadoop:hadoop-core:0.20.2-with-200-826    11 Mar 2013 at 22:15 (IST)
  org.apache.hadoop:hadoop-common:0.23.6                                                 29 Jan 2013 at 05:53 (IST)
  org.apache.servicemix.bundles:org.apache.servicemix.bundles.hadoop-core:0.20.203.0_3   21 Jan 2013 at 04:37 (IST)
  org.apache.hadoop:hadoop-common:0.23.5                                                 20 Nov 2012 at 20:29 (IST)
11:43 AM
(And yes, e.g. org.scray😒cray-hdfs-writer:1.1.1 does provide an implementation of
org.apache.hadoop.fs.FileSystem
)
Oz Katz

Oz Katz

08/24/2022, 1:17 PM
I initially read that as "scary" instead of "scary" and it made perfect sense to me, as anything that writes to HDFS is by definition, scary.
Ariel Shaqed (Scolnicov)

Ariel Shaqed (Scolnicov)

08/24/2022, 1:44 PM
*scray 🙂 But yours is better.