Artifactspublic-v0

curl

master
ply4 git calls227 ms288 KiB2 cachedprotocol v2
116 lines3.0 KiBRaw

NAME

CURLOPT_WILDCARDMATCH - directory wildcard transfers

SYNOPSIS

c
#include <curl/curl.h>

CURLcode curl_easy_setopt(CURL *handle, CURLOPT_WILDCARDMATCH, long onoff);

DESCRIPTION

Set onoff to 1 if you want to transfer multiple files according to a filename pattern. The pattern can be specified as part of the CURLOPT_URL(3) option, using an fnmatch-like pattern (Shell Pattern Matching) in the last part of URL (filename).

By default, libcurl uses its internal wildcard matching implementation. You can provide your own matching function with the CURLOPT_FNMATCH_FUNCTION(3) option.

Starting in curl 8.24.0, curl limits the maximum number of matching directory entries in a single directory to 100,000.

A brief introduction of its syntax follows:

* - ASTERISK

ftp://example.com/some/path/*.txt

matches all .txt files in the root directory. Only two asterisks are allowed within the same pattern string.

? - QUESTION MARK

Question mark matches any (exactly one) character.

ftp://example.com/some/path/photo?.jpg

[ - BRACKET EXPRESSION

The left bracket opens a bracket expression. The question mark and asterisk have no special meaning in a bracket expression. Each bracket expression ends by the right bracket and matches exactly one character. Some examples follow:

[a-zA-Z0-9] or [f-gF-G] - character interval

[abc] - character enumeration

[^abc] or [!abc] - negation

[[:name:]] class expression. Supported classes are alnum,lower, space, alpha, digit, print, upper, blank, graph, xdigit.

[][-!^] - special case - matches only '-', ']', '[', '!' or '^'. These characters have no special purpose.

[[]] - escape syntax. Matches '[', ']' or 'e'.

Using the rules above, a filename pattern can be constructed:

ftp://example.com/some/path/[a-z[:upper:]\\].jpg

%PROTOCOLS%

EXAMPLE

c
extern long begin_cb(struct curl_fileinfo *, void *, int);
extern long end_cb(void *ptr);

int main(void)
{
  CURL *curl = curl_easy_init();
  if(curl) {
    /* turn on wildcard matching */
    curl_easy_setopt(curl, CURLOPT_WILDCARDMATCH, 1L);

    /* callback is called before download of concrete file started */
    curl_easy_setopt(curl, CURLOPT_CHUNK_BGN_FUNCTION, begin_cb);

    /* callback is called after data from the file have been transferred */
    curl_easy_setopt(curl, CURLOPT_CHUNK_END_FUNCTION, end_cb);

    /* See more on https://curl.se/libcurl/c/ftp-wildcard.html */
  }
}

%AVAILABILITY%

RETURN VALUE

curl_easy_setopt(3) returns a CURLcode indicating success or error.

CURLE_OK (0) means everything was OK, non-zero means an error occurred, see libcurl-errors(3).

1---
2c: Copyright (C) Daniel Stenberg, <daniel@haxx.se>, et al.
3SPDX-License-Identifier: curl
4Title: CURLOPT_WILDCARDMATCH
5Section: 3
6Source: libcurl
7See-also:
8 - CURLOPT_CHUNK_BGN_FUNCTION (3)
9 - CURLOPT_CHUNK_END_FUNCTION (3)
10 - CURLOPT_FNMATCH_FUNCTION (3)
11 - CURLOPT_URL (3)
12Protocol:
13 - FTP
14Added-in: 7.21.0
15---
17# NAME
19CURLOPT_WILDCARDMATCH - directory wildcard transfers
21# SYNOPSIS
23~~~c
24#include <curl/curl.h>
26CURLcode curl_easy_setopt(CURL *handle, CURLOPT_WILDCARDMATCH, long onoff);
27~~~
29# DESCRIPTION
31Set *onoff* to 1 if you want to transfer multiple files according to a
32filename pattern. The pattern can be specified as part of the CURLOPT_URL(3)
33option, using an **fnmatch**-like pattern (Shell Pattern Matching) in the last
34part of URL (filename).
36By default, libcurl uses its internal wildcard matching implementation. You
37can provide your own matching function with the CURLOPT_FNMATCH_FUNCTION(3)
38option.
40Starting in curl 8.24.0, curl limits the maximum number of matching directory
41entries in a single directory to 100,000.
43A brief introduction of its syntax follows:
45## * - ASTERISK
47 ftp://example.com/some/path/*.txt
49matches all `.txt` files in the root directory. Only two asterisks are allowed
50within the same pattern string.
52## ? - QUESTION MARK
54Question mark matches any (exactly one) character.
56 ftp://example.com/some/path/photo?.jpg
58## [ - BRACKET EXPRESSION
60The left bracket opens a bracket expression. The question mark and asterisk have
61no special meaning in a bracket expression. Each bracket expression ends by the
62right bracket and matches exactly one character. Some examples follow:
64**[a-zA-Z0-9]** or **[f-gF-G]** - character interval
66**[abc]** - character enumeration
68**[^abc]** or **[!abc]** - negation
70**[[:name:]]** class expression. Supported classes are **alnum**,**lower**,
71**space**, **alpha**, **digit**, **print**, **upper**, **blank**, **graph**,
72**xdigit**.
74**[][-!^]** - special case - matches only '-', ']', '[', '!' or '^'. These
75characters have no special purpose.
77**[[]]** - escape syntax. Matches '[', ']' or 'e'.
79Using the rules above, a filename pattern can be constructed:
81 ftp://example.com/some/path/[a-z[:upper:]\\].jpg
83# %PROTOCOLS%
85# EXAMPLE
87~~~c
88extern long begin_cb(struct curl_fileinfo *, void *, int);
89extern long end_cb(void *ptr);
91int main(void)
93 CURL *curl = curl_easy_init();
94 if(curl) {
95 /* turn on wildcard matching */
96 curl_easy_setopt(curl, CURLOPT_WILDCARDMATCH, 1L);
98 /* callback is called before download of concrete file started */
99 curl_easy_setopt(curl, CURLOPT_CHUNK_BGN_FUNCTION, begin_cb);
101 /* callback is called after data from the file have been transferred */
102 curl_easy_setopt(curl, CURLOPT_CHUNK_END_FUNCTION, end_cb);
104 /* See more on https://curl.se/libcurl/c/ftp-wildcard.html */
105 }
107~~~
109# %AVAILABILITY%
111# RETURN VALUE
113curl_easy_setopt(3) returns a CURLcode indicating success or error.
115CURLE_OK (0) means everything was OK, non-zero means an error occurred, see
116libcurl-errors(3).
Diagnostics4 git calls · 227 ms
CallStatusSizeTime0227 ms
discover200152 B1 ms
git.upload-pack discover
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=ls-refs
git.upstream.dur_ms=1
git.response.bytes=152
git.server.agent=gitty/1.0
git.server.object_format=sha1
git.server.caps=agent ls-refs fetch object-format
git.server.fetch=shallow filter sideband-all
git.protocol.version=2
git.pkt.frames=8
git.pkt.data=6
git.pkt.flush=2
git.pkt.delim=0
git.pkt.bytes=152
git.pkt.payload.max=34
ls-refs200149 B · hit2 ms
git.upload-pack ls-refs
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=ls-refs
git.upstream.dur_ms=2
git.response.bytes=149
git.response.cache=HIT
git.response.duration_ms=2
git.protocol.version=2
git.pkt.frames=3
git.pkt.data=2
git.pkt.flush=1
git.pkt.delim=0
git.pkt.bytes=149
git.pkt.payload.max=78
git.ls_refs.count=2
git.ls_refs.head=refs/heads/master
fetchblob:none · deepen 10200287 KiB · hit3 ms
git.upload-pack fetch
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=fetch
git.upstream.dur_ms=3
git.response.bytes=293470
git.response.cache=HIT
git.response.duration_ms=3
git.fetch.filter=blob:none
git.fetch.filter.requested=tree:0
git.fetch.filter.fallback=blob:none
git.fetch.filter.learned=false
git.fetch.wants=31c911efe5652725e930f4d2e60c9060e5f6646d
git.fetch.haves.count=0
git.fetch.deepen=10
git.fetch.thin_pack=false
git.fetch.ofs_delta=true
git.protocol.version=2
git.pkt.frames=10
git.pkt.data=8
git.pkt.flush=1
git.pkt.delim=1
git.pkt.bytes=293470
git.pkt.payload.max=65516
git.sideband.band1.bytes=293354
git.sideband.band2.bytes=0
git.sideband.band3.bytes=0
git.pack.objects=87
git.pack.bytes=293354
git.pack.ofs_delta=0
git.pack.ref_delta=1
git.pack.chain.max=1
git.pack.trailer=6a646bcda6740bab42e321b51998b52ea15146c0
git.pack.full=86
Open pack map
fetch2001.5 KiB222 ms
git.upload-pack fetch
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=fetch
git.upstream.dur_ms=222
git.response.bytes=1587
git.response.cache=MISS
git.response.duration_ms=222
git.fetch.wants=03cb9ec1eb08c9ac853c7e23ac69e0ec9f4231ed
git.fetch.haves.count=0
git.fetch.deepen=0
git.fetch.thin_pack=false
git.fetch.ofs_delta=true
git.protocol.version=2
git.pkt.frames=3
git.pkt.data=2
git.pkt.flush=1
git.pkt.delim=0
git.pkt.bytes=1587
git.pkt.payload.max=1566
git.sideband.band1.bytes=1565
git.sideband.band2.bytes=0
git.sideband.band3.bytes=0

Each row is one HTTP round trip ply made to the git server for this page, on one timeline. discover asks what the server speaks, ls-refs lists branch tips, fetch brings objects by id. A hit was served by Workers Cache. Tap a row for its wire details.

Remote
https://5ad2236b39de4c8bd8f6270ea63f3ea9.artifacts.cloudflare.net/git/public-v0/curl.git
Ref
refs/heads/master
Commit
31c911efe5652725e930f4d2e60c9060e5f6646d
cf-ray
a5e313151a733e6e
Request
e3817470…
Protocol
v2 · sha1
Agent
gitty/1.0
Filter
advertised
Fetch
shallow filter sideband-all
Capabilities
agent ls-refs fetch object-format